A161  443 


REPORT  DC-73 


AUGUST  1984 


"COORDINATED  SCIENCE  LM-RR, 
DECISION  AND  CONTROL  LABORA 

MINIMAX  DECISION  PROBLEMS 
FOR  GAUSSIAN  TEST  CHANNELS 
IN  THE  PRESENCE  OF 
UNKNOWN  JAMMING  NOISE 


■Sts'- 


■M* 


'■-m 


38 


UNCLASSIFIED 

SECURITY  CLASSIFICATION  OF  THIS  FAGS 


/  (»  /  */r  3 


REPORT  DOCUMENTATION  PAGE 


1A  REPORT  SECURITY  CLASSIFICATION 

UNCLASSIFIED 


2<l  SECURITY  CLASSIFICATION  AUTHORITY 

N/A 


2b.  OECLASSIFICATION/OOWNGRAOING  SCHEOULE 

N/A 


A.  PERFORMING  ORGANIZATION  REPORT  NUMBER(S) 

R-101S  (DC-73) 


lb.  RESTRICTIVE  MARKINGS 

NONE 


3.  OISTRI8UTION/AVAILA8ILITY  of  report 

Approved  for  public  release,  distribution 
uni imited. 


S.  MONITORING  ORGANIZATION  REPORT  NUMBER(S) 

N/A 


6a.  NAME  OF  PERFORMING  ORGANIZATION  Sb.  OFFICE  SYMBOL  7a.  NAME  OF  MONITORING  ORGANIZATION 

Coordinated  Science  Laboratory  tirwiicabi*> 

University  of  Illinois  N/A  Joint  Services  Electronics  I 


6c.  AOORESS  (City.  Slat*  and  ZIP  Cod *1 

1101  W.  Springfield  Ave. 
Urbana,  Illinois  61801 


Joint  Services  Electronics  Program 


7b.  AOORESS  (City.  Stata  and  ZIP  Coda) 

Research  Triangle  Park,  NC  27709 


Ba.  NAME  OF  FUNOING/SPONSORING 
ORGANIZATION 


18b.  OFFICE  SYMBOL  9.  PROCUREMENT  INSTRUMENT  IDENTIFICATION  NUMBER 

(If  applicable) 


Sc.  AOORESS  (City.  Stat*  and  ZIP  Coda) 


11.  TITLE  (Inctud*  Security  Clarification/  MimiMX  DeCISIOn 

“ems  for  Gaussian  Test  Channels  in  the 


12.  PERSONAL  AUTHOR(S)  u  .  ...  .. 


Ying  Wan  Wu 


13a.  type  of  REPORT 

Technical 


13b.  TIME  COVERCO 
FROM _  TO 


is.  supplementary  notation 

N/A 


17.  COSATI  COOES 


field  I  group  I  sub.  gr. 


10.  SOURCE  OF  FUNOING  NOS. 


PROGRAM 

element  no. 


PROJECT 

TASK 

NO. 

NO. 

N/A 

N/A 

WORK  UNIT 
NO. 


1A.  DATE  OF  REPORT  (Yr..  Mo,.  Day)  15.  PAGE  COUNT 

September  1984  72 


IB.  SUBJECT  TERMS  IContinu*  on  revert*  if  necettary  and  identify  by  block  number) 


19.  ABSTRACT  (Continue  on  r*v*rte  if  necettary  and  identify  by  block  number) 


20.  oistribution/availability  of  abstract 
UNCLASSIPIEO/UNLIMITEO  —  SAME  AS  RPT  Zj  OTIC  USERS  □ 


22a.  NAME  OF  RESPONSIBLE  INOIVIOUAL 


21.  ABSTRACT  SECURITY  CLASSIFICATION 

UNCLASSIFIED 


22b  TELEPHONE  NUMBER  |22c.  OFFICE  SYMBOL 

tlnciude  .Area  Cod*>  I 


OD  FORM  1473,  83  APR 


EDITION  OF  I  JAN  73  IS  OBSOLETE. 


UNCLASSIFIED _ 

SECURITY  CLASSIFICATION  OF  THIS  =  AGE 


MINIMAX  DECISION  PROBLEMS  FOR  GAUSSIAN  TEST  CHANNELS  IN 
THE  PRESENCE  OF  UNKNOWN  JAMMING  NOISE 


BY 


YING  WAH  WU 


B.S.,  Columbia  University,  1981 


THESIS 

Submitted  in  partial  fulfillment  of  the  requirements 
or  the  degree  of  Master  of  Science  in  Electrical  Engineering 
in  the  Graduate  College  of  the 
University  of  Illinois  at  Urbana-Champaign,  1984 


Accession  For 

NT IS  GPA&I 
DTIC  TAM 
Unannou:. ' .  • 
Just  if  ic-  '  . 


By - 

Distrib;* 

Availr-b  i  1 1 


Urbana,  Illinois 


UNIVERSITY  OF  ILLINOIS  AT  URBANA-CHAMPAIGN 


THE  GRADUATE  COLLEGE 


JANUARY  1984 


WE  HEREBY  RECOMMEND  THAT  THE  THESIS  BY 
_ YING  WAH  WU _ 

ENTITLED _ MINIMAX  DECISION  PROBLEMS  FOR  GAUSSIAN  TEST  CHANNELS  IN 

_ THE  PRESENCE  OF  UNKNOWN  JAMMING  NOISE _ 

BE  ACCEPTED  IN  PARTIAL  FULFILLMENT  OF  THE  REQUIREMENTS  FOR 
THE  DEGREE  OF _ MASTER  OF  SCIENCE _ 

of  Thesis  Research 


Head  of  Department 


Committee  on  Final  Examination! 

_ 

i  Chairman 


+  Required  for  doctor's  degree  but  not  for  master's. 


i 


.V 


iv 


I 


TABLE  OF  CONTENTS 


CHAPTER 


.V 

w 


"'J 


-  ‘ . 


g 


1.  PROBLEM  FORMULATION  . 

1.1.  Introduction  . . . 

1.2.  Complete  Description  of  the  Scalar  Problems  . 

1.3.  Review  of  Recent  Literature  . 

1.4.  Vector  Extension  of  Cases  (i)  and  (ii)  . 

2.  SOLUTION  FOR  THE  SCALAR  COMMUNICATION  SYSTEM  . 

2.1.  Saddle-Point  Solution  for  Case  (iii)  . 

2.2.  Saddle-Point  Solution  for  Case  (i)  . 

2.3.  Derivation  of  a  Min. Max.  Solution  for  Case  (ii)  . 

2.4.  Verification  of  a  Max. Min.  Solution  for  Case  (ii)  .... 

2.5.  Summary  of  the  Scalar  Solutions  in  All  Cases  . 

3.  SOLUTIONS  FOR  COMMUNICATION  SYSTEMS  WITH  VECTOR  SIGNALS  AND 

VECTOR  CHANNELS  . 

3.1.  The  Saddle-Point  Solution  for  Vector  Case  (i)  . 

3.2.  Numerical  Examples  on  Vector  Case  (i)  . 

3.3.  Derivation  of  Max. Min.  Solution  in  Vector  Case  (ii)  .. 

3.4.  Derivation  of  a  Min. Max.  Solution  for  Vector  Case  (ii) 

3.5.  Summary  of  the  Solutions  in  All  Vector  Cases  . 

4.  CONCLUSION  . 

4.1.  Summary  of  Results  . 

4.2.  Continuation  and  Extension  . 

REFERENCES  . 


v  wvv  .•  ■- 


CHAPTER  1 


PROBLEM  FORMULATION 


1.1.  Introduction 

/V 

In  this  thesis,  we  study  solutions  to  a  class  of  communication 
problems  which  involve  transmission  of  a  sequence  of  input  variables  over 
noisy  channels  under  a  given  power  constraint  and  in  the  presence  of  an 
intelligent  jammer.  In  the  next  few  sections,  precise  formulations  of  the 
problems  will  be  presented.  Generally,  either  the  saddle-point  solutions 
(Def.  1-1),  or,  (if  it  does  not  exist)  the  worst-case  solutions  by  both 
min. max.  and  max. min.  approaches  will  be  obtained  for  each  problem. 

I 

In  Chapter  2,  we  consider  a  class  of  scalar  problems,  and  determine 
the  corresponding  policies  explicitly  in  analytic  form  (either  saddle-point 
solutions  or  worst-case  solutions).  Then,  we  summarize  all  the  results 
pertaining  to  the  scalar  problem  in  Table  2.1. 

In  Chapter  3,  we  treat  vector  versions  of  the  problems  considered 
in  Chapter  2.  First  we  obtain  solutions  for  two  classes  of  vector  problems 
explicitly  in  analytic  form,  and  when  explicit  solutions  are  not  possible 
we  develop  a  general  recursive  procedure  for  computing  the  corresponding 
solutions . 

Chapter  4  discusses  some  extensions  of  the  theory  presented  in 
this  thesis,  proposes  topics  for  further  research,  and  provides  a  general 
summary  of  the  totality  of  the  results  obtained  in  the  thesis.  After  that, 
all  references,  [1]— [8] ,  are  listed  on  the  last  page  of  this  thesis. 


2 


1.2.  Complete  Description  of  the  Scalar  Problems 

The  general  class  of  jamming  problems  to  be  treated  in  this  thesis 
admit  two  scalar  versions. 

Version  1:  The  first  scalar  version  is  completely  described  by  the 

communication  system  depicted  in  Fig.  1.1.  The  main  communication  channel 

is  additive  and  memoryless,  with  an  additive  jamming  noise,  y,  and  a  Gaussian 

noise,  w.  The  noiseless  side  channel  permits  information  to  flow  in  the 

forward  direction  from  the  transmitter  to  the  receiver  under  the  restriction 

that  only  the  information  about  the  current  structure  of  the  encoding  policy 

of  the  transmitter  is  allowed  to  be  sent  over  it.  The  problem  is  to  transmit 

the  input  signal,  u, reliably  through  the  main  communication  channel  to  the 

receiver,  in  the  presence  of  the  intelligent  jammer  (whose  role  is  yet  to  be 

clarified)  and  the  Gaussian  noise,  w,  with  the  aid  of  tne  side  channel. 

This  will  entail  an  optimum  design  of  encoders  and  decoders  as  to  be 

elucidated  in  the  sequel.  We  now  first  provide  a  precise  mathematical 

description  of  the  system  depicted  in  Fig.  1.1. 

The  input  signal,  u,  is  a  sequence  of  independent,  identically 

distributed  Gaussian  random  variables  with  zero  mean  and  unit  variance. 

The  transmitter  converts  the  input  signal,  u, into  the  variable,  x, with  the 

encoding  policy  y(u)  being  an  element  of  the  space  rg  of  random  mappings 

2  2 

satisfying  the  power  constraint  E{(y(u)  }<c  .  By  adopting  a  worst-case 

analysis,  we  assume  that  the  jamming  noise  could  be  correlated  with  the 

message,  u,  and  therefore  let  y  =  g(u) ,  where  the  jammer  polic”  g  is  chosen 

from  the  space  T.  of  random  mappings  satisfying  the  power  constraint, 

2  2 

E(S  (u))<k  .  Finally,  the  channel  noise,  w, is  a  sequence  of  independent. 


T5 


•■'V 


identically  distributed  Gaussian  random  variables  with  zero  mean  and  variance 
^  >  0,  and  w  is  independent  of  u,  x,  and  y.  Now  the  channel  output  to  the 
receiv  ?r  will  be 

z  =  x  +  y  +  w 

The  estimator  of  the  receiver,  <5(z)  seeks  to  estimate  the  input  signal  based 
on  the  measurement  of  z  under  a  mean  square  error  criterion  where  &(•)  is, 
in  general,  an  element  of  the  space  T  of  random  mappings  from  H  into  HR. 

Ct 

Version  2:  The  second  scalar  version  differs  from  the  previous  version  only 
in  the  sense  that  the  side  channel  is  now  absent  (depicted  later  in  Chapter  2) 
For  future  reference,  we  will  call  the  first  and  second  versions  as 
case  (i)  and  case  (ii) ,  respectively.  The  following  mathematical  formulation 
will  apply  to  both  cases. 

Both  the  transmitter-receiver  pair  and  the  jammer  seek  to  optimize 
the  same  criterion,  J(y , <5 ,8),  which  is  the  expected  mean  square  error  of 
estimating  the  input  signal,  u.  Algebraically, 

J(Yj'5,B)  =  E{  (u  -  &  (x  +  y  +  w))2} 

The  roles,  however,  are  different;  while  the  jammer  wants  to  maximize  J, 
the  transmitter-receiver  pair  tries  to  minimize  the  same  criterion.  Because 
of  this  conflict  of  interest,  we  seek  to  obtain  either  a  saddle-point 
solution,  or,  if  it  does  not  exist,  the  worst  case  solutions  by  min. max.  and 
max. min.  approaches. 

In  the  min. max.  approach,  we  proceed  to  evaluate  the  following 

expression 


J 


min.  max.  J(y,<5,8) 

y^f  ger. 
e  j 

6erd 


(l.i 


To  evaluate  J  ,  first  the  maximization  of  J(y,<$,B) 
carried  out  for  each  possible  pair  of  encoding  and 
(y,6)»  in  the  space  of  the  Cartesian  product  of  the 
Hence,  for  each  fixed  pair,  (y,6),  we  should  obtain 
solution  exists) 


over  the  space  F  ^  is 
decoding  policies, 
two  spaces,  F^  and  F,. 
(assuming  that  such  a 


S,  =  arg.  max  J(y,<$,6) 
g€r 

J 


(1.2: 


equivalently , 


J(Y,6,B(  g))  >  J(y,6,8)  ,  V8S  F, 


1 k  : k 

The  next  step  is  to  pick  out  a  pair  (y  ,5  )  from  the  space  Fg  x  F^  such  that 


it  minimizes  J(y,<$,3^  •  Algebraically, 


*  *  & 

(y  ,5  )  =  arg.  min.  J(y,5,S, 

(y,<5)  e  r  x  r  u’o; 


(1.3 


Equivalently, 


-* 

J 


•HvV.S*/  J*,)  -  J<Y,6,6(Y,3)) 


V(y,5)€F  x  r , 
e  d 


This  is  the  so-called  upper  value  of  the  zero-sum  game  with  kernel  J. 

For  the  max. min.  approach  we  simply  interchange  the  order  of  the 


maximization  and  minimization  operations: 


=  max.  min.  J(y,5,B) 

Ber.  y€  r 


Firstly,  we  minimize  J(y,6,8)  with  respect  to  (y,6)  for  each  fixed  jamming 


policy  g(*)-  Let  us  define,  for  fixed  6(‘), 


£  k 

)  =  arg  min. 

(y,6)£  r  x  r 

e  d 


J  (7,6,6) 


equivalently , 


J  (Yg ,  6g  ,  6)  <  J(y,6 ,8)  ,  V(y,6)6rg  x  Fd 

*  * 

Then,  J(y  ,5  ,3)  is  maximized  over  the  space  F..  So  we  define 
DP  J 

•k  k  k 

3  *  arg.  min.  J(y  ,6  ,5) 

8€Fj  3 


equivalently, 


J*  =  J(y**,d**,3")  >  J(y*,5*,S)  ,  V8 6  r j 

This  is  the  so-called  lower  value  of  the  zero-sum  game  whose  kernel  is  J. 

k  k  k 

Definition  1.1:  If  there  exists  a  triple  (y  ,5  ,6  )£F  x  F,  x  T. 
-  e  d  j 


satisfying  the  set  of  inequalities 


J (y  ,<5  ,6)  <  J(y  ,C  ,6  )  <  J(y,6,e  )  ,  VySF^  o6"d,  8  -  F 


k  k  k  k  k  k 

then  (y  ,c  ,3  )  is  a  saddle-point  solution,  and  J(y  ,6  ,g  )  is  the 


saddle-point  value. 


The  recent  result  in  the  literature  which  is  closely  related  to 
our  work  here  is  the  one  obtained  by  Ba§ar  [3].  The  communication  system 
treated  in  his  paper  is  depicted  below  in  Fig.  1.2.  The  three  channel  noises 
present  in  Fig.  1.2.,  w^,  ,  v,  are  Gaussian  and  independent  of  each  other. 

Further,  w^  and  v  are  independent  of  x  and  u,  and  is  independent  of  x,  u, 
and  v.  The  jammer  feeds  back  a  jamming  noise  to  the  channel  based  on  a 
noisy  version  of  the  encoded  signal,  y  =  x  +  v  +  w^.  Other  aspects  of  the 
communication  system  in  [3]  are  the  same  as  those  we  have  introduced  earlier 
in  Section  1.2. 

In  order  to  be  able  to  compare  the  results  of  [3]  with  the  ones  to 
be  obtained  in  this  thesis,  we  simplify  the  communication  system  of  Fig.  1.2 
by  setting  =  a  =  0,  =  and  calling  w^  =  w.  With  these  simplifications 

the  variable,  y,  is  no  longer  distinguishable  from  x,  which  we  henceforth 
call  x.  Furthermore,  to  be  consistent  with  the  notation  of  Fig.  1.1,  we 
replace  v  of  Fig.  1.2  with  y.  With  this  new  notation,  the  communication 
system  of  Fig.  1.2  has  been  reproduced  below  as  Fig.  1.3.  Exact  expressions 
for  the  saddle-point  solution  of  the  communication  system  of  Fig.  1.3  will  be 
summarized  in  Section  2.1  as  Theorem  1.  For  future  reference  we  will  call 


this  problem  case  (iii). 


1.4.  Vector  Extension  of  Cases  (i)  and  (ii) 

The  vector  version  of  case  (i)  is  completely  described  by  the 
communication  system  depicted  in  Fig.  1.4.  Here,  the  input  vector,  u£Fn, 
is  a  sequence  of  independent,  identically  distributed  Gaussian  random  vectors 
with  mean  zero  and  covariance  matrix  Z  >  0.  An  admissible  encoder  policy  is 
a  probability  distribution  on  the  set  of  all  mxn  linear  mappings,  A  :  ]Rn-+-Rm, 
with  second  moment  no  greater  than  P.  We  denote  the  class  of  all  such 
probability  distributions  by  fl  .  Further  let  £2  =  {A  :  Tr(AZA')  <  P}  and 
z €  be  a  random  vector  such  that 

z  =  x  +  v  +  r 

Here,  the  random  vector,  v €  Km,  is  controlled  by  an  intelligent  jammer,  and  is 
allowed  to  be  correlated  with  the  input  vector,  u.  Denote  the  class  of 
associated  probability  measures  y  for  v  satisfying  the  power  constraint 
E(v'v)  =  Tr[A]  <  Q,  by  v.  (Here  A  denotes  the  covariance  matrix  of  v.)  The 
channel  noise,  r,  is  a  sequence  of  independent,  identically  distributed 
Gaussian  random  vectors  with  mean  zero  and  covariance  matrix,  R>0,  and 
independent  of  v  and  u. 

Finally,  the  estimator  of  the  input  vector  u  based  on  the  measurement, 
z,  will  be  denoted  $(•),  and  the  class  of  all  such  estimators  will  be  denoted 
by  D.  There  is  a  side  channel  between  the  encoder  and  the  decoder,  which 
provides  the  decoder  with  the  structural  information  regarding  the  choice  of 


the  encoder. 


The  vector  version  of  case  (i)  is  completely  described  by  the 
communication  system  depicted  in  Fig.  1.4.  Here,  the  input  vector,  u€  Hn, 
is  a  sequence  of  independent,  identically  distributed  Gaussian  random  vectors 
with  mean  zero  and  covariance  matrix  £  >  0.  An  admissible  encoder  policy  is 
a  probability  distribution  on  the  set  of  all  mxn  linear  mappings,  A  :  2Rn-*-Rm, 
with  second  moment  no  greater  than  P.  We  denote  the  class  of  all  such 
probability  distributions  by  fi  .  Further  let  12  =  {A  :  Tr(AIA')  <  P}  and 
z€nmbe  a  random  vector  such  that 

z  =  x  +  v  +  r 

Here,  the  random  vector,  v€Rm,is  controlled  by  an  intelligent  jammer,  and  is 
allowed  to  be  correlated  with  the  input  vector,  u.  Denote  the  class  of 
associated  probability  measures  u  for  v  satisfying  the  power  constraint 
E(v'v)  =  Tr[A]  <  Q,  by  v.  (Here  A  denotes  the  covariance  matrix  of  v.)  The 
channel  noise,  r,  is  a  sequence  of  independent,  identically  distributed 
Gaussian  random  vectors  with  mean  zero  and  covariance  matrix, R>0,  and 
independent  of  v  and  u. 

Finally,  the  estimator  of  the  input  vector  u  based  on  the  measurement 
z,  will  be  denoted  6(>)>  and  the  class  of  all  such  estimators  will  be  denoted 
by  D.  There  is  a  side  channel  between  the  encoder  and  the  decoder,  which 
provides  the  decoder  with  the  structural  information  regarding  the  choice  of 


the  encoder. 


Vector  case  (ii)  is  formulated  in  exactly  the  same  way  as 
vector  case  (i)  described  above,  with  the  only  two  differences  being  that 
now  there  is  no  side  channel  and  no  probabilistic  coding  is  allowed  at  the 
encoder.  In  vector  case  (ii)  the  encoding  policy  will  be  restricted  to  the 
class  of  linear  decision  rules,  X  =  Au,  where  A€  q  is  deterministic.  If, 
in  the  linear  class,  A  is  allowed  to  be  random,  no  improvement  can  be  achieved 
in  the  performance  of  the  encoder-decoder  pair.  For  vector  case  (i),  the 
distortion  measure  is  given  by 

J(y ,6,u)  =E{(6(x  +  v  +  r)-u)'(<5(x  +  v  +  r)  -  u)  }  (1.8) 

and  for  case  (ii)  by 

J  (A, 6  ,u)  =  E{  (5  (Au  +  V  +  r)  -  u)  ’  (6(Au  +  V  +  r)  -  u)  }  (1.9) 

We  again  seek  a  saddle-point  solution  for  J,  or  worst-case  solutions  by 
min. max.  and  max. min.  approaches  if  a  saddle-point  solution  does  not  exist. 
These  are  conceptually  the  same  as  those  introduced  earlier  for  scalar 
versions  and  hence  will  not  be  discussed  in  great  detail.  We  only  point  out, 
for  future  reference,  that  (1.7)  can  be  rewritten  as  case  (i) : 

J (y  ,<5,u)  <  J(Y  , <5  ,y*)  <  J(y,5,y  )  ,  VyS^,  6€d,  ySv  (1.10) 
and  case  (ii)  : 

J(A  ,5  ,y)  <  J(A  ,6  ,u  )  <  J(A,5,y  )  ,  VA*=  ft,  o£D,  y€\>  (1.11) 

Lemma  1.1  is  still  valid  for  the  vector  cases,  by  defining  J  and  J  in  a  way 
similar  to  (1.1)  and  (1.4). 
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CHAPTER  2 


SOLUTION  FOR  THE  SCALAR  COMMUNICATION  SYSTEM 


This  chapter  is  concerned  mainly  with  the  derivation  of  solutions 
to  all  the  scalar  cases  previously  introduced  in  Chapter  1.  First,  the 
saddle-point  solution  for  case  (iii)  is  reviewed  in  Section  2.1.  Following 
that,  Section  2.2  provides  the  saddle-point  solution  for  case  (i)  and  its 
proof.  Then,  the  min. max.  solution  and  max. min.  solution  are  presented  and 
verified  respectively,  in  Section  2.3  and  Section  2.4.  After  presenting 
the  solutions,  we  summarize  and  compare  these  results  in  the  last  section 
(Section  2.5). 


2.1.  Saddle-Point  Solution  for  Case  (iii) 

In  this  section,  we  present  (in  Theorem  2.1)  the  saddle-point 
solution  for  the  communication  system  of  Fig.  1.3.  Before  doing  this  we 
first  introduce  some  parametric  regions  in  terms  of  k,  c,  and  which  will 
be  used  throughout  the  chapter: 


R^  :  k  >  c 

R0  :  k  <  c 
2 

R^  :  k  -  ck  +  £  >  0 

R.  :  k^  -  ck  +  ^  <  0 
4 

Theorem  2.1  [3] :  The  communication  system  shown  in  Fig.  1.3  admits  two 

*  *  *  *  * 

saddle-point  solutions  (y  ,6  ,S  )  and  (-y  ,-6  ,3  )  over  the  space 


ii)  8  (x)  = 


arbitrary 

in 

R1 

cu 

in 

R2 

-X 

in 

R1 

-k 

—  X 

c 

in 

R2n  R, 

(k2  +  <fi) 

-  - - 2 - x  +  n 

in 

R2°  R 

(2.2) 


where  n  is  a  zero-mean  Gaussian  random  variable  with  variance  k 
and  independent  of  other  random  variables. 


(2.3) 


2  2 
(kz  + 


iii)  <5  (z)  -  (  0 


c  -  k 


(c  -  k)  + 


iv)  the  optimal  value  of  J : 


in  R2r' 


in  R, 
2  4 


(2.4) 


k  k  k  k 

J  (Y  ,5  ,8  ) 


I  V? 

I  - ~ -  in  R_>>  R.. 

(c  -  k)Z  +  * 


n 

k"  + 

2 

c 


in  R^  R4 


(2.5) 


2.2.  Saddle-Point  Solution  for  Case  (i) 

The  communication  system  of  case  (i)  has  been  redepicted  in  Fig.  2.1 


In  the  following,  we  will  first  summarize  the  saddle-point  solution  in 
Theorem  2.2,  its  necessary  conditions  in  Corollary  2.1,  and  then  present  their 
proofs.  At  this  point,  we  digress  to  clarify  some  notation.  The  pair 


( Yl , 6 i>  will  mean  that  while  the  transmitter  is  using  a  certain  encoding 
policy,  y,  (either  deterministic  or  a  particular  realization  of  a  mixed 
policy) ,  he  informs  the  receiver  of  his  policy  in  current  use  through  the 
side  channel,  and  in  response  the  receiver  decodes  its  input,  z  using  the 
corresonding  decoding  policy,  6  .  Furthermore,  "w.p."  will  stand  for  "with 
probability."  Hence,  when  the  expression  "(7^,6^)  w.p.  p^"  appears,  this 
will  mean  that  both  the  encoding  policy,  Y^>  and  the  decoding  policy,  <5^, 
are  used  simultaneously  with  probability  p... 

Theorem  2.2:  For  the  communication  system  of  Fig.  2.1,  there  exists  a 

*  *  * 

saddle-point  solution  (y  ,  <$  >8  ),  given  as  follows: 


*  * 
i)  (Y  ,8  ) 


(cu,  — ~ ~ - )  w.p. 1/2 

.  C  +  It  +  ifi 


(-CU, - ^ - 2 - 

c"  +  k  +  'f 


•)  w.p.  1/2 


ii)  6  (u)  =  n 


where  n  is  a  zero-mean  Gaussian  random  variable  with  variance  k  and  is 
independent  of  both  u  and  w. 

iii)  The  saddle-point  value  of  J  is 

*  k2  +  v- 

"c2+k2+. 


Corollary  2.1:  (y  ,6  )  given  in  (2.6)  is  a  unique  saddle-point  soluti  a  in 
the  space  x  And  if  8  is  a  saddle-point  solution  in  the  space  F^,  the 
jamming  variable,  v,  generated  by  £(•)>  must  be  uncorrelated  with  the  input, 


e.,  E 


Proof  for  Theorem  2.2:  We  need  to  prove  that  the  solution  given  in 
Theorem  2.2  satisfies  the  saddle-point  inequality  for  Vy^T^,  6  6  B 6  T 


J(Y*,6*,6)  <  J(y*,<5*,6*)  <  J(y,6,B*) 


(2.9) 


The  proof  will  be  completed  in  two  steps.  First,  we  will  show  that  the 
right-hand  side  inequality  of  (2.9)  is  satisfied,  i.e.,  the  pair  of  encoding 

k  k  k 

and  decoding  policies,  (y  ,5  ),  as  specified  by  (2.6),  minimize  J(y,5,B  ) 

k 

over  the  space  i  x  r^,  given  that  the  jamming  policy,  8  ,  is  in  current  use 

by  the  jammer.  Secondly,  the  left-hand  side  inequality  of  (2.9)  will  be 

*  * 

verified,  i.e.,  when  the  pair  of  encoding  and  decoding  policies,  (y  ,6  ),  is 

k  k 

chosen  by  the  transmitter  and  the  receiver,  J(y  ,5  ,B)  is  maximized  by  the 
* 

jamming  policy,  B  ,  over  ,_he  space  T.  . 

a)  Verification  of  the  right-hand  side  inequality:  Assume  t.iat  the  jamming 
* 

policy,  B  ,  is  given  by  (2.7).  Hence,  the  input  signal  to  the  receiver  is 


Z  =  X  +  q  +  w 


Referring  to  [1],  for  a  Gaussian  test  channel,  the  transmitter  should  amplify 
the  magnitude  of  the  input,  u,  linearly  at  his  given  energy  level.  Thus, 

y(u)  =  cu  or  -cu 

In  cooperation  with  the  transmitter,  the  receiver  must  adapt  3aves'  estimate 

k 

correspondingly  in  either  encoding  policies.  When  y  (u)  =  cu,  the  Baves' 
estimate  is 


_  -  +  E[ (u  -  u) (z  ~  z) ] 


(z  -  z)  ;  u  =  E [u] 


E[ (z  -  z)2] 


because,  the  sum  of  n  +  w  is  still  Gaussian,  Eu  =  0  and  E(z)  =  E(x)  +  En  Ew  = 


L" '  i 
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Hence,  6(z)  =  z 

E(zZ) 


7  2  2  2 

E(z“)  =  E(cu  +  n  +  w)  =  c  +  k  +  P 


E(uz)  =  E(u(cu  +  n  +  w) )  =  cEu  =  c 
6(z)  becomes 


6  (z)  = 


2  2 
c  +  k  +  P 


Similarly,  for  6  (u)  =  -cu,  we  obtain 


*  —  C 

6  (z)  =  -r - ^ -  Z 

c  +  k~  +  P 


So,  this  proves  the  validity  of  (2.6)  in  Theorem  2.2. 

b)  Verification  of  the  left-hand  side  inequality:  Assuming  that  the  pair 

A  T'C 

of  encoding  and  decoding  policies  (y  ,5  )  are  as  given  in  (2.6),  we  first 

k  k 

compute  the  expected  mean  square  error,  J(y  ,6  ,S)  by  conditioning  on  the 
specific  structural  realization  of  encoding-decoding  policies  in  current  use. 


i)  When  (cu, 


cz 


2  2 
c  +  k  +  P 


)  is  the  realized  policy  pair,  we  have 


J11  E(  2  ,  ,2 


cz  .  2 

- u) 


c  +  k  +  p 


-•  \i 


^  * 


c  2 

=  E(-p - T - (cu  +  y  +  w)  -  u) 

c  +  k  +  * 


(2.10) 


(k“  +  P ) ' 


11 


(c"  + 


2  2  '  2  2 
k  +  v')  (c  +  k  +  P 


p)‘ 


2c(k~  +  P) _ 

o  9  ^ 

(c“  +  k“  +  p)im 


E(y“)  + 


E(uy) 


->2  2 

(c-  +  kz  +  <r 


■  j 


■ft 

liiil 


»* -  -**  .V  •*«  *  V,'  “  »  ■  * 


«-'■  Cal  v'-‘-  ■  aw ■  v~-  ■Jv““ 


ii)  with  (u)  =  -cu,  and  5  =  - 


2  2 
c  +  k  +  $ 


,  we  obtain 


cz 


J12  “  E(  2  ,  , 2 


-  u)‘ 


c  +  k  +  V 


=  E( 


2  2 
c  +  k  +  'f 


(-  cu  +  y  +  w)  -  u) ' 


(2.11) 


2  2 
(k  +  l)Z 


12  ,  2  ^  ,  2  ^  ,2  ,  2  2  ,2 

(c  +  k  +  y)  (c  +  k  +  *p) 


E(y  )  + 


2  2  2 
(c  + 


+  ^C(k  „+  *>  ,  E(uy) 


2  2  2 
(c  +  kz  +  *y 


By  unconditioning  the  above  conditional  values  of  J,  we  obtain 


*  2  1  1 
J  =  E (5  (w  -  u)  =  fjn+  j J12 


2  2 
(k  +  l)Z 


2  2  2 
(c  +  k  +  *) 


(2.12) 


2  2  2 
(c  +  k  +  V?) 


E(y  )  + 


2  2  2 
(c  +  k  +  <fi) 


which  indicates  that  J  is  dependent  only  on  the  second  order  moment  of  y. 


Hence,  the  maximizing  solution  is  any  random  variable  with  second  order  moment 


equal  to  k“;  and  the  Gaussian  random  variable  n,  with  mean  zero  and  variance 


,  2  . 


k  is  one  such  random  variable. 


2  2  2  2 
„  *  _  (kz  +  *)“  .  c~k^ 

Hence  $  J  2  ^  o  '  *7  o  2 


2 

c  <e 


^  2  2  2  2  2  2  2 
(c  +  k  +  'f)  (c  +  k  +  s?)  (c  +  k  +  u>) 


k"  +  £ 


2  2 
c  +  k  +  £ 


This  then  completes  the  proof  of  Theorem  2.2. 


Proof  for  Corollary  2.1:  By  the  property  of  interchangeability  of  the 
saddle-point  solution  [2],  any  further  possible  saddle-point  solution 


(besides  (2.7))  for  the  jamming  policy  should  be  in  equilibrium  with  (y  ,5  ) 
given  in  (2.6).  We  will  now  verify  the  uncorrelation  between  the  input,  u, 
and  the  jamming  variable,  y,  by  contradiction. 


If  E(uy)  >  0,  choosing 

(y,6)  =  (cu,  — — ^2 - )  W-P-  1  (2.13) 

c  +  k  +  'fi 


then  it  follows  from  (2.10)  and  (2.12)  that  (y,6)  will  yield  lower  value  for 

*  *  *  * 

J  than  the  (y  ,6  )  in  (2.6)  does.  This  contradicts  the  optimality  of  (y  ,6  ) 

given  in  (2.6). 

An  analogous  reasoning  can  be  made  for  the  case  when  E(uy)  <  0  with 
(2.11)  and  (2.12).  Hence,  this  proves  that  E(uy)  =  0  is  necessary  for  8  to  be 

k  * 

a  saddle-point  solution.  Next,  we  show  that  (y  ,5  )  in  (2.6)  is  unique  in 
the  space  F^  x  T^. 


Assume  (y,$)  =  f  (cu,  — ~ ^ - ) 

!  c  +  k“  + 


w.p.  p 


(2.14) 


( — cu  ,  - 


-)  w.p.  1-p 


c  +  k  + 


Again,  by  the  property  of  interchangability  of  the  saddle-point  solutions, 
if  (y  ,6)  in  (2.14)  is  a  saddle-point  solution,  then  it  will  be  in  equilibrium 

•k  i< 

with  i  in  (2.7).  So  2  in  (2.7)  will  maximize  J  given  that  (y,£)  in  (2.14) 
is  adopted  by  the  transmitter  and  the  receiver. 


By  (2.10)  and  (2.11) 


pJ12  +  ^  '  P)J 

2  2 
(k  +  £) 

2  2  2 
( c  k  +  ) 


12 


2  2 

(c  +  k  +  s?) 


2c(k  4-  l) 
2  2 

(c  +  k  +  *) 


2  >  +  72 


.  2  2 
(c  +  k  +  <£) 


(2.15) 


J~  (1  -  2p)E(uy) 


By  inspection  of  (2.15),  since  8  in  (2.7)  is  the  maximum  solution,  the  last 
term  in  (2.15)  must  be  zero,  i.e.,  l-2p  =  0=!>'p  =  1/2,  so  p  =  1/2  is  the 

-v  ^  Jc 

only  solution  for  (y,<5)  to  be  in  equilibrium  with  B  in  (2.7). 

Therefore,  the  uniqueness  of  (y  ,5  )  in  (2.6)  has  been  proved.  ° 

The  following  will  now  provide  an  introduction  to  the  analyses  of 

the  remaining  sections,  where  we  highlight  the  motivation  to  derive  the  • 

worst-case  solutions  by  min. max.  and  max. min.  approaches  in  case  (i-i'. 

Let  us  first  compare  the  max. min.  approaches  in  cases  (i)  and  (ii)  .  Given 

* 

a  specific  jamming  policy,  6  ,  in  both  cases  the  transmitter  and  the  receiver 

will  achieve  the  same  optimal  value  of  J  since  there  would  be  no  need  to 

randomize  encoder  policies  and  hence  to  use  the  side  channel.  Thus,  the 

max. min.  approaches  would  lead  to  the  same  lower  value  of  the  game  in  both 

cases.  On  the  other  hand,  the  min. max.  approaches  will  yield  the  same 
—  * 

upper  value,  J  in  cases  (ii)  and  (iii)  due  to  the  fact  that  any  randomization 
in  the  encoder  policy  is  not  helpful  in  minimizing  J  and,  hence,  both  jammers 
in  cases  (ii)  and  (iii)  will  access  the  same  information  from  the  given 


(7,5). 


It  then  follows  from  the  above  discussion  and  the  statements  of 

—  A 

Theorems  2.1  and  2.2  that  in  case  (ii)  the  min. max.  value  of  J,  J  ,  is 


always  strictly  greater  than  the  max. min.  value  of  J,  J  ,  and,  therefore,  by 
Lemma  1.1,  a  saddle-point  solution  will  not  exist  in  case  (ii) . 


2.3.  Derivation  of  a  Min. Max.  Solution  for  Case  (ii) 

Now,  we  eliminate  the  side  channel  in  the  communication  system  of 
Fig.  2.1.  The  result  is  the  communication  system  depicted  in  Fig.  2.2,  for 
which  the  min. max.  solution  is  given  below  as  Theorem  2.3. 

Theorem  2.3:  For  the  scalar  problem  of  case  (ii) ,  there  exist  two  min. max. 

*  *  *  *  *  * 
solutions:  (y  ,5  ,6  )  and  (-y  ,-6  ,-B  )  where 


i)  y  (u)  = 


arbitrary 

cu 


in  R„ 


in  R_ 


ii)  3  (u)  = 


* 

Y  (~  u) 


/  -ku 


in  R, 


in  R^  '  R^ 


any  arbitrary  second- 
order  random  variable 
,  with  E(y^)  =  in  R^  n  R^ 


iii)  o  (z)  = 


l  c  -  k 


(c  -  k)“  +  v? 


in  R, 


in  R„  n  R-, 
Z  j 


(2.16 


(2.17 


(2. IS 


z 


in  R0  R. 


Figure  2.2.  The  Gaussian  test  channel  for  version  (ii) . 


in  ft 


(2.19) 


(c  -  k)  +  1 p 


k2  4-  sfi 


in  R„ Q  R. 
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Proof :  In  the  following,  we  first  solve  the  minimization  problem  given  that 

the  jamming  policy,  8(*)»is  always  specified  in  terms  of  the  encoding  policy, 
y(u)  or  x.  Of  course,  the  minimum  value  obtained  under  this  specified  jamming 
policy  will  constitute  a  lower  bound  for  the  original  min. max.  problem  of 
case  (ii) .  Later,  we  will  prove  that  this  lower  bound  can  actually  be 
achieved  by  some  encoding  and  decoding  policies. 

Region  R^ .  In  mathematical  terms,  we  have 

—  * 

J  »  min.  max  J  >  min  r(y,6,8(u)  =  y(-  u) )  (2.20) 

yer  ser.  '  yer 

e  j  e 

<5<=r  ser, 

a  a 


Consider  the  right-hand  side  of  (2.20):  6(u)  =  y(-  u)  means  that  the  jammer 
is  adopting  the  same  policy  of  the  encoder  to  generate  the  jamming  variable, 
y  but  using  the  negative  value  of  the  current  input,  u  as  its  argument  (he 
can  do  that  because  k  >  c) . 

Hence,  x  and  y  are  conditionally  independent,  given  u.  With 
z  =  x  +  y  +  w,  the  conditional  density  of  u  given  z  will  be  even  symmetric: 
i .e .  ,  f (u  z)  =  f  (-  u ! z)  . 


Therefore,  the  Bayes  estimate  will  be  zero. 


<5(z)  =  E(u|  z )  =  /  uf(u|z)du  =  0 
—  00 

J  =  E(0  -  u)2  =  Eu2  =  1 


From  (2.20) , 


J*  >  1  (2.2 


TC  X 

This  lower  bound  in  (2.21)  has  been  attained  by  y  and  6  in  (2.16)  and 
(2 . 18) ,  correspondingly . 

Region  ^2^%:  Similar  to  Region  R^,  we  have 


min .  max . 

yer  ger. 

e  J 

*'erd 


J  >  min.  J(y,6,B(u) 
■  YeTe 

<5  6  r 

a 


|  E(x | u) ) 


(2.2 


Considering  the  right-hand  side  of  (2.22),  the  input  signal  to  the  receiver 
is : 


z  =  x  -  —  E(x  |  u)  +  w 

=  (1  -  —  )x  +  — (x  -  E(x|u))  +  w 
c  c 


(2.2 


Let  us  digress  to  consider  the  following  two  optimization  problems, 

(a)  our  original  problem:  Seeking  to  send  tne  input  u  optimally  through  the 

following  channel  in  the  sense  of  mean  square  error, 

z  =  (1  -  — )x  +  — (x  -  E(x|u))  +  w 


25 


*  - 

r 


I 


a 


IL 


r 


Here  x  is  generated  by  the  encoding  policy,  y(u) ,  satisfying  the  power 
2  2 

constraint  E(x  )  <  c  ,  and  w  -  N(0,^). 

(b)  the  transformed  problem  split  expression  (2.23)  into  two  parts:  and 

where 


I  z.  =  (1  -  —  )x  +  r 
i  c 

\ 

Z2  =  !(x  "  E(xlu)) 


(2.24a) 


Instead  of  z  in  (2.23),  z^  and  z^  in  (2.24a)  are  received  by  the  receiver. 
This  transformed  problem  achieves  a  minimum  square  error  which  is  lower  than  . 
the  one  of  the  problem  (a) .  By  manipulating  on  these  data  z^  and  z? 
algebraically,  we  obtain 


1  -  * 

c 


=  X  + 


1  -  * 

c 


(2.24b) 


=  x  -  E  (x  |  u) 


Further , 


z,  =  x  + 


1 


1  -  * 
c 


(2.24c) 


z  =  E(x  |  u)  +  - r 

1  -  - 


Since  z^  and  2^  -  are  obtained  from  z^  and  z0  by  nonsingular  linear 
transformations,  we  see  from  (2.24c)  that  the  randomized  encoding  policy  is 
totally  unnecessary;  hence,  we  can  say  that  an  optimal  encoding  policy  exists 
as  a  deterministic  function  of  u.  When  the  encoding  policy  is  restricted  to 
deterministic  rules,  z,,  becomes  zero  in  (2.24a). 


The  channel  in  the  transformed  problem  (b)  is  thus  reduced  to 
single  Gaussian  test  channel.  Hence,  x  =  cu  or  -  cu  is  an  optimal  encoding 
policy  in  (b) .  Without  loss  of  generality,  we  choose  x  =  cu,  hence,  (2.24a) 
or  (2.23)  becomes 


satisfying 


E(uy)  =  -  k 


since  ck  -  k  >f  <  0 


By  Cauchy-Schwartz  inequality,  E(pB(u))  =  -  k  can  be  achieved  by  choosing 

a  2  2 

3  (u)  =  -  ku,  uniquely.  Substituting  E(B  (u))  =  k  and  E(u8(u))  =  -  k  back 

into  (2.27),  we  obtain 


*P  +  (c  -  k) 

The  value  of  J  obtained  above  is  the  same  as  that  in  (2.26).  Hence,  the 
proof  has  been  completed  for  the  region 

Region  R2riR4*  Following  the  lines  of  the  previous  derivation,  we  have 


min.  max.  J  >  min.  J(y,6,B(u) 

y  €  r  s<=  v  r 

e  j  e 

ser.  ser, 

a  a 


— -I--"-'  E(x|u)  +  n)  (2. 


where  n  -  N(0,  k^  — ) 

c 


For  the  right-hand  side  of  (2.29),  write  z  as 


where 


2 

z  =  x  -  - E(x|u)  +  n  +  w 

c 

=  (1  -  — — — ■ ) x  -  — — (x  -  E  (x  |  u) )  +  r 
c“  c 

2  2 
2  (k  + 

r  =  n  +  w  N(0,  k  +  *  -  —  2  > 

c 


Similar  to  the  procedure  in  the  Region  R^ n  R^ >  again,  the  optimal  encodin 


policy  will  be 


y(u)  =  cu  or  -  cu 


28 


Without  loss  of  generality,  we  choose  y(u)  =  cu.  Then,  (2.30) 


becomes 


so , 


z  =  (1  -  - — y-^-)cu  +  y 

C  2 

,,  k  + 

(1 - s — )c 


(2.32) 


6 (z)  =  E(u I z)  = 


a  -  i-iVc2  +  k2  , 


z_ 

c 


(2.33) 


Then, 


J  = 


2 

k  +  * 


(2.34a) 


and 


min.  max.  J  > 

Yer  ger. 

e  3 

6€rd 


2 

k  +  * 


(2.34b) 


To  prove  attainability  of  the  lower  bound  in  (2.34b),  take  y  and  6  as  given 
in  (2.16)  and  (2.18),  respectively. 


J  =  E(y  (z)-  u)2  =  ■—  (^  +  E(y2)) 


(2.35) 


Maximizing  J  above  with  respect  to  admissible  8,  the  solution  is  any  3 
2  2 

satisfying  E(y  )  =  k  ,  which  in  turn  leads  to 


*  1  2 
J  =  (*  +  k  ) 

c 


(2.36) 


Again,  the  value  of  J  in  (2.36)  is  the  same  as  the  lower  bound  in  (2.34b). 


This  then  completes  the  proof  of  Theorem  2.3. 
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2.4.  Verification  of  a  Max. Min.  Solution  for  Case  (ii) 

After  the  completion  of  the  solution  of  the  min. max.  problem,  we 
now  proceed  with  the  max. min.  solution  for  case  (ii) ,  which  is  given  in  the 
following  theorem. 

Theorem  2.4:  For  the  scalar  problem  of  case  (ii) ,  there  exist  two  max. min. 

*  *  *  *  *  * 


solutions  over  F  x  F.  x  T. 

e  d  j 


:  (y  ,5  ,3  )  and  (-y  ,-6  ,-3  )  where 


* 


i)  y  (u)  =  cu 
ii)  S  (u)  =  n 


(2.37) 

(2.38) 


2  2 

where  n  is  the  Gaussian  random  variable  with  E(un)  =  0  and  E(n")  =  k 


iii)  6  (z)  = 


cz 


2  2 
c  +  k  +  <p 


(2.39) 


and 


T*  k  +  *p 

iv)  J  =  - 


2,.2, 

c  +  k  +  v 


(2.40) 


Proof :  In  the  following  we  first  solve  the  max. min.  problem  given  that  the 

encoding  and  decoding  policies  can  only  be  linear  decision  rules.  Of  course, 
the  max. min.  value  obtained  under  this  restriction  on  the  spaces  of  encoding 
and  decoding  policies  will  constitute  an  upper  bound  for  the  original  max. min. 
problem  of  case  (ii) .  Later,  we  will  prove  that  this  upper  bound  can  actually 
be  achieved  at  a  certain  jamming  policy.  In  mathematical  terms,  we  have 


max.  min.  J  <  max.  min.  J  (2.41) 

8<=  r.  y€  r  3  5  r.  a,£G]R 

J  e  J 

r,  y(u)  =  *u 

a 

6(z)  =  7.z 


where  on  the  right-hand  side  of  the  inequality,  (2.41),  the  minimization  is 
carried  out  over  the  real  scalars,  a, A. 

Starting  with  the  right-hand  side, 

J  =  E(6  -  u)2  =  E(A(otu  +  y  +  w) -  u)2 

=  E[(Aoi  -  l)u  +  Ay  +  Aw]2 

»  J  =  (Aql  -l)2  +  A2*  +  A2E(y2)  +  2A (Aa  -  l)E(uy)  (2. 

2  2 

It  is  intuitively  clear  that  E(y  )  =  k  will  be  chosen  by  the  jammer 
2 

(provided  that  A  >  0) ,  so  that 

J  =  (Aa  -  l)2  +  A2*  +  A2k2  +  2A(Aa  -  l)E(uy)  (2. 

Differentiating  J  with  respect  to  A: 

J  =  2a(Aa  -  1)  +  2A(*  +  k2)  +  2(2aA  -  l)E(uy)  (2. 

- 2  2  2 

■2-x  J  =  2a  +  2sP  +  2k  +  4aE(uy)  >0  (2. 

3  A^ 

3  i 

and  setting  —  J  =0 

3A  |A* 

»  a (A*a  -  1)  +  A*(vs  +  k2)  +  (2aA*  -  l)E(uy)  =  0 


we  obtain 

.*  _  _ a  +  E(uy) _ 

L  -y  2 

q“  +  k  +  ^  +  2aE(uy) 

* 

as  the  unique  minimizing  A  ,  for  fixed  a,  since  the  second  derivative  is 
positive  by  (2.45)  . 


.....  .  1'.  ■ ■  ■  :.L  L.  Jl  i  t.  V'.  'A  v  ViJ. 


where  J  I  *  *(0)  =  —5 - y-^ — 

' A  ,ct  c“  +  k  +  'P 


'A  ,a 

dv 


is  undefined. 


‘v  =  0 


Hence,  arg  (max  J I  *  A)  =  0  and  then  E(uy)  =  0.  Substituting  E(uy)  =  0 
v  '  A  ,a 

*  A 

back  into  (2.46)  and  (2.48)  giving  A  and  a  ,  respectively,  we  obtain 


(2.51) 


2  2 
c  +  k  +  ^ 


and  S  is  any  second-order  random  variable  such  that 


E(uy)  =  0  and  E(y^)  =  k^ 


*  i 

J  =  J 


(0)  = 


k“  + 


*  *  VVJ'  0  2 

A  ,a  c"  +  k  +  sf 


(2.52) 


(2.53) 


Now,  we  need  to  show  that  the  inequality  in  (2.41)  is  in  fact  an  equality  for 

some  jamming  policy  satisfying  (2.52).  Towards  this  end,  we  first  note  that 

a  possible  jamming  policy  satisfying  (2.52)  is  the  Gaussian  random  variable 
2 

p  ~  N(0,  k  )  independent  of  u  and  w.  For  this  choice,  the  signal  at  the 
input  of  the  receiver  becomes 


z  =  x  +  n  +  w 


which  is  clearly  the  Gaussian  test  channel  considered  in  [  1  ]  .  We  know  from  [1’ 
that  in  the  general  class  of  endcoder-decoder  mappings,  the  solution  is  linear 


and  given  by  y  (u)  =cuand  (z)  =  — ; - 

c~  +  k~  + 

of  J  is 


z.  The  corresponding  value 


k  +  c  +  <f 


Since  J  above  equals  to  jj  ^  *(0)  (2.53),  it  follows  that  the  left-hand 

'A  ,a 

side  of  (2.41)  cannot  be  strictly  less  than  the  right-hand  side.  Hence,  the 
linear  encoder-decoder  policy  pair  obtained  above  is  indeed  optimal  for  the 
max. min.  problem  of  case  (ii) . 

This  then  completes  the  proof  of  Theorem  2.4.  c 

From  Theorems  2.3  and  2.4,  since  in  case  (ii)  the  min. max.  value 

—  *  k 

of  J,  J  is  always  strictly  greater  than  the  max. min.  value  of  J,  J  ,  the 
following  corollary  follows: 

Corollary  2.2:  In  case  (ii)  a  saddle-point  solution  does  not  exist.  c 


2.5.  Summarv  of  the  Scalar  Solutions  in  All  Cases 


Let  us  now  collect  the  results  presented  in  the  previous  sections 
and  present  them  comparatively  in  Table  2.1.  The  highlights  of  this 
comparison  are  the  following: 

1)  The  saddle-point  value  of  J  in  case  (i)  is  the  same  as  the  max. min.  value 

& 

of  J,  J  in  case  (ii).  Notationallv,  max. min.  of  (i)  *=*  max. min.  of  (ii) . 

—  k 

2)  The  min. max.  value  of  J,  J  in  case  (ii)  attains  the  saddle-point  value 
of  J  in  case  (iii)  .  Notationallv,  min. max.  of  case  (ii)  ^  min. max.  of  case 
(iii)  . 

■k 

3)  The  value  of  J  in  case  (ii)  and  the  saddle-point  value  of  J  in  case  (i) 
are  always  strictly  less  than  the  min. max.  value  of  J,  J  in  case  (ii)  and 
the  saddle-point  value  of  J  in  case  (iii),  respectively. 


where  W'N(0,k 


CHAPTER  3 


SOLUTIONS  FOR  COMMUNICATION  SYSTEMS  WITH  VECTOR  SIGNALS 

AND  VECTOR  CHANNELS 

This  chapter  is  concerned  with  the  derivation  of  saddle-point, 
min. max.,  and  max. min.  solutions  for  vector  case  (i)  and  (ii) .  In  Section 

3.1,  the  saddle-point  solution  for  vector  case  (i)  is  derived  and  is 
summarized  in  Theorem  3.1.  To  gain  a  deeper  insight  into  and  to  illustrate 
Theorem  3.1,  some  numerical  examples  are  solved  in  Section  3.2.  Following 
that.  Section  3.3  provides  a  discussion  of  the  derivation  of  a  max. min. 
solution  for  vector  case  (ii) ,  and  summarizes  the  main  results  in  Theorem  3.2 
Then,  the  rain. max.  approach  fcr  vector  case  (ii)  is  discussed  in  Section  3.4. 
It  seems  that  there  do  not  exist  closed  form  expressions  for  the  min. max. 
solution  (vector  case  (ii))  for  all  parametric  regions;  however,  in  some 
regions  in  the  parameter  space  the  solution  can  be  obtained  in  closed-form 
and  this  has  been  presented  in  Theorem  3.3.  The  section  also  includes  a 
numerical  example  to  illustrate  the  theorem.  Finally,  the  last  section 
contains  a  comparative  discussion  of  the  results  presented  in  earlier 
sections . 

3.1.  The  Saddle-Point  Solution  for  Vector  Case  (i) 

Before  presenting  the  saddle-point  solution  in  Theorem  3.1,  we 
first  introduce  some  notation  in  the  following. 

Let  *7,  U  be  unitary  matrices  that  diagonalize  R  and  Z,  respectively 
and  order  their  eigenvalues,  i.e., 


and 


it  Hit  =  diag(r,  ,r0 ,  —  ,r  )  ;  0  <  r.  <  r„...<  r 

in  i  —  i  —  m 

U£U "  =  diag(X.  , . . .  >...>A  >0 

i  n  1  -  -  n 

*  k 

Define  an  h  xh  matrix  T  as 

o 

T  =  /  0  0  ...  0  1 

I  0  1  ...  0  0 

'  0  0  ...  1  0 

and  let  an  raxm  matrix  H.  be  introduced  as 

l 

l 

Ti  °) 

0  l'  .  for  i-1 . h*-l 

Further,  let 

W  =  it  diag  (a, ... ,o,r  ,r)  it'  »  n  diag(w  ,  ...,w  )  - ' 

h  +1  m  1  m 

and 

r^  "F  •  •  •  d"  Q 

0  "  - * - 

h 

k 

where  h  is  the  smallest  positive  integer  such  that  the  following 

k 

inequality  holds  for  h  =  h  +1: 

(rl  -  rl)  +  •••  +  (rh  -  rh-1)  >0 

If  there  is  no  h  <  m  for  which  the  above  inequality  holds,  then  let  h 
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Define  an  mxn  matrix  G  =  [g  ]  by 

ij 


fg..  =  (V^  -  w .)1/2/fT. 

sn  »  a  1  V  1 

o 


*13-° 


for  i  <  £ 


for  i#j ,  or  i  >  £ 


(3.8) 


K- 


P  +  Z  w. 
i-1  1 


(3.9) 


and  £  is  the  maximum  integer  which  satisfies  the  following  inequality: 


—  >  a 
w.  o 
l 


for  1  <  i  <  £ 


(3.10) 


The  following  theorem  now  provides  a  saddle-point  solution  for 
vector  case  (i) : 

Theorem  3.1:  For  the  communication  problem  of  vector  case  (i)  depicted  in 

*  *  * 

Figure  1.4,  a  saddle-point  solution  (y  ,6  ,p  )  exists  over  the  space 

ft  x  D  x  D  where 
s 

i)  the  transmitter-receiver  pair  is 


*  *  /  *  * 
(y,5  )  =  (A  u  ,  K  z) 


(V-1U  ’  V-lz) 


(-A  u  ,  -K*z) 

o  o 


l  (_Ah*-lu  ’  -Kh*-lz) 

&  *  it  -k  A 

where  A.  =  t  H.GU,  and  K.  =  Z  A. '  (A.  Z  A.  '  +  W) 

i  l  l  iii 


w.p.  — * 
.  2h 


w.p.  — 
2h 


w.p.  — r 
.  2h 


w.p.  — 
2h 


(3.11) 


ii)  the  jamming  policy  is 


* 

v  =  n 


(3.12) 


where  n  is  a  zero  mean  Gaussian  noise  with  covariance  A  such  that 

•k 

A  —  tt  diag(o  -  r^,...,a  -  r^.i,  0,...,0)  it',  and  n  is  independent  of  all  other 
random  vectors. 


iii)  the  saddle-point  value  of  J  is 

.2 

n 

+  Z  X. 


* 

J  = 


P  +  Z  w. 
i-1  1 


i=2.+l 


(3.13) 


Proof :  Let  us  first  rewrite  the  saddle-point  inequality, 

J(y*,(5*,u)  <  J(Y *,6*,p*)  <  J(Y,<S,U*)  ;  Vy€ns,  6€d,  pSt?  (3.14) 

In  the  following,  we  first  verify  the  right-hand  side  inequality  of  (3.14)  and 
then  the  left-hand  side  inequality. 

k 

i)  Right-Hand  Side  Inequality:  Given  v  as  specified  in  (3.12),  the  sum  of 
jamming  vector  and  channel  noise,  r,  becomes  a  zero  mean  Gaussian  noise  with 
covariance  W.  This  then  entails  optimal  transmission  of  an  input  vector 
reliably  over  the  Gaussian  vector  channel  to  the  receiver.  So 

z  =  x  +  n  +  r  (3.15) 

where  n  +  r  is  additive  zero-mean  Gaussian  noise  with  covariance  W.  This 
type  of  problem  has  been  solved  in  [5]  and  [6].  Referring  to  [6],  the 
optimal  linear  encoding  policy  is 
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x  =  A  u  (3.16a) 

Vc  * 

where  A  =  TGU  and  T'WT  =  diag(c, ... ,o,r,  *  .... ,r  )  with  T'T  =  I.  A  is  not 

h  +1  m 

unique  since  the  unitary  transformation  T  is  not  unique;  it  could  be  any  one 
of  the  matrices 


ffH  »  ttH^  j  .  ■  m 7TH^*_i 


(3.16b) 


Let  us  verify  the  experssions  for  T  given  above.  Firstly,  for 


i=0,  since  H  =  I, 
o 


ttHq  diag(a , . . .  ,a,rh*+1, . .  .  >rm)H^  ' 


—  7rdiag(cr,...,cf,  ’ ' ' ' ' ^m^  ^ 


=  W 


(3.17) 


Secondly,  for  i^O, 


■rrtL  diag(o , .  . .  ,0 »rh*+1  *  •  •  •  *rm)H(^ ' 


=  IT 


T1  0N 


0  I. 


T1crIT1' 
o  o 


diag (a , . . . ,o,rh*+1, . . • ,rm) 


diag(rh*+1,...,rm)y 


v° 


=  rr  diag(a, .  .  .  ,o,rh*+1, .  ..  ,rm)ir'  =  W 


(3.18) 


ffl 


Corresponding  to  each  optimal  linear  encoding  rule  x 


optimal  estimator  is  linear: 


<5*(z)  =  K*z  =  E  A* ' (A*  E  A*'  +  W)_1z 
i  1  11  1 


The  optimal  value  of  J  in  (3.13)  has  been  derived  in  [5]  or  [6] 
ii)  Left-Hand  Side  Inequalit 


Given  (y  ,6  )  as  specified  in  (3.11),  referring  to  [4]  and 

conditioning  on  the  particular  structure  of  the  transmitter  and  receiver 

*  * 

chosen  to  be  implemented,  y^(u)  =  A^u,  and  <$^(z)  =  K^z,  we  obtain 

J  (y  ,<5 ,  p  I  y  =  A?u ,  6  =  K*z)  =  E  {v'K*'K*v  -  2v'K*'(I  -  K*A*)E(u|v)} 

1  l  l  u  ii  l  l  i  v  1  ' 


+  Tr{ (I *-  K*A*)E(I  -  K*A*) '  +  K*RK* ' } 
i  l  ii  ii 


Then,  unconditioning  (3.20)  under  the  probability  distribution  specified  in 

(3.11),  the  second  term  in  the  first  expectation  of  (3.20)  cancels  out 

*  *  *  * 

(since  both  pairs  (A^.K^)  and  (-A^,-K^)  appear  with  equal  probability), 
leaving 

Jj  * 

h— It  *  *  *  *  *  *  *  * 

J(y,6,u)  -  E  ^E  iv'K.'K.v}+  E  —  Tr  { I-K  A . )  E  ( I-K .  A .  )  '+  K .  RK .  }  (3. 

i=0  h  M  1  1  i=0  h 


Since  only  the  first  term  in  (3.21)  depends  on  the  structure  of  the  jamming 
policy,  the  maximization  problem  is  reduced  to  the  following  equivalent 
maximization  problem: 


max  E  E  [v'K.'K.v]  ,  s.t.  Tr{A;  <  0 

je,?  i=o  11 


(3. 


Let  us  first  write  out 


.  .  a  A  w!"  -j  '•  \  ,  w 

'i  K1  =  "Hi  dia8(^T  V wi}  •* '  w~  'V  “T 


£ 


-  wj  0  ...  0)H  :n " 
£'  1 


(3.23) 


Fact  I: 


ct  /  A  .w . 
o  .  /  1  1 

e  (v  — 

1  o 


Ot  /  A  .  W  . 

wi}  i  7T  (V  -  - 

3 


>  for  i  <  j 


Now,  to  investigate  how  affects  the  structure  of  the  diagonal  matrix  in 


(3.23), 


let  B  = 


,/b 11 

1 

hi) 

9 

and  note 

\B21 

hiJ 

H.BHr  = 

l  l 

//T1B 
1  o 

\ 

11  o 

'  0  \ 

\ 

0 

B12  / 

r1  0\ 


\°  V 


Taking  diagonal,  we  obtain 

ToBllTo  =  diag  (bh*,h*  ’  bl,l’***»bh*-l,h*-l) 

Fact  ^  ToBnTo'  =  diag(V+i_i,h^i-i”-*‘bi,r-‘-’V-i,h*-i) 


Also,  using 
h*-l 


the  transformation  n  =  n'v  in  (3.22),  we  obtain 


max 
u  €  i?  i=0 


2  E(n'H  diag  0/ 

=n  1  wi 


xiwi 


-  w  )  ...  —  0/ 

1  W. 

I 


X  „  w. 
J 


-  -  w  )  0 


0)H'n) 


(3.24) 


subject  to  Tr{A}  <  Q 

where  n  *  (n,  ...  n  )  ' 

1  m 

Now,  we  have  two  cases  which  need  to  be  considered  separately  here: 

*  * 
a)  h  <1  and  b)  h  >1 


a)  For  h  <£,  using  Fact  II  in  (3.24),  we  obtain 


max* 


h*  a  /XT wT 

I  —  (t/-^  -  w.) 

^lLi  =  lW3  V  ao  \ 


h  -  S.  a 

.E,  E('>i)  +.  h  ,  57 

i=l  i=h  -1  l 


(A.w.  . 

"  wi)E(ni» 


(3.25) 


subject  to  Tr{N}  < Q  where  N  =  E(nn'). 


Using  Fact  I,  the  optimal  solution  will  satisfy 

k 

^  *2 

E  E(n.  )  =  Q 

i=l 


One  of  several  possible  optimal  solutions  will  be: 

kO  k 

E(ni  )  =  a  -  ri  for  1  <  i  <  h 

* 

and  E(ninj)  =  0  for  it j ,  or  i>h 

In  conclusion,  N*=  diag(a  -  r^,...,a  -  r^*,0,...,0) 

k  k  k  k 

so  .1  =  iN  it  ,  v  =  irn 

*  * 
hence,  v  is  a  zero  mean  Gaussian  noise  with  covariance  A  . 

b)  For  h  ■>£ ,  (3.24)  becomes 

/—  -  —  * 

X .  w ,  h  „ 

-J-J-  -  w.)]  E  E(nT)  s.t.  Tr{N} <  Q  (3.26) 

a  j  .  .  i 

new  j  =  l  J  o  1=1 

where  and  N  admit  the  same  definition  as  in  a). 

The  only  difference  here  is  that  the  second  term  in  (3.25)  is  absent; 
however,  the  maximization  problem  does  not  depend  on  that  term.  So  the  same 


conclusion  can  be  drawn  as  in  a) .  This  then  completes  verification  of  the 
optimal  jamming  policy  in  (3.12).  - 


We  note  at  this  point  that  expressions  given  in  (3.16a)  and 


(3.16b)  do  not  cover  all  choices  of  the  optimal  encoding  policy,  given  that 
* 

v  in  (3.12)  is  adopted  by  the  jammer.  By  the  property  of  interchangability 

of  the  saddle-point  solutions  [2],  other  possible  saddle-noint  policies  for 

the  transmitter-receiver  pair  will  have  essentiallv  the  same  form  as  (3.11), 

so  that  any  of  these  policies  will  lead  to  an  objective  function  similar  to 

2  * 

(3.25)  or  (3.26),  in  which  each  element  of  (E(n7),  i=l,...h  1  has  the  same 
coefficient . 

The  following  corollary  now  gives  a  set  of  necessary  conditions  to. 

a  saddle-point  policy  for  the  jammer.  We  present  it  without  any  proof  since 

it  is  similar  to  that  of  the  scalar  case,  with  (3.20). 

Corollary  3.1:  If  u  is  a  saddle-point  policy  for  the  jammer,  then  the 

jamming  variable,  v,  generated  by  the  probability  distribution,  u  will 

* 

satisfy  the  following  equality,  for  i=0,...,h  -1. 


E{v'K*'(I  -  K*A*)u}  =  0 


(3.27: 


3.2.  Numerical  Examples  on  Vector  Case  (i) 

In  this  section,  we  present  some  numerical  examples  to  illustrate 
Theorem  3.1. 

Example  1 :  Here  we  take  the  dimension  of  the  input  vector  to  be  two,  n=2  and 
the  number  of  channels  to  be  three,  m=3.  Let  the  covariance  of  input  vector 


ffi 
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and  the  channel  noise  covariance  be 


R  = 


1  0  0  \ 
0  2  0  ] 
0  0  3  / 


*  - 

iii)  the  saddle-point  value  of  J  is  J  =  2.43. 

In  this  example,  the  optimal  policy  dictates  the  transmitter  to 
send  only  the  first  element  of  the  input  vector  but  through  either  one  of 
first  two  channels  such  that  each  one  of  them  will  be  used  with  equal 
probability,  since  the  jammer  has  equalized  the  first  two  eigenvalues  of 


channel  noises.  If  Che  power  of  the  jammer  is  not  large  enough  to  equalize 


more  than  one  eigenvalue  of  the  channel  noise,  then  this  example  can  be 
reduced  to  the  scalar  problem  (which  has  been  treated  in  Section  2.2). 

On  the  other  hand,  the  mixing  policy  of  the  transmitter  and 
receiver  pair  in  this  problem  will  admit  the  equilization  jamming  policy  in 
equilibrium  with  itself.  Since  the  jammer  cannot  predict  which  channel  has 
transmitted  the  signal,  he  can  only  do  his  best  by  trying  to  equalize  over 
all  the  eigenvalues  of  the  channel  noise. 
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0  .  (5-^M,1/\u 

1  +  /2  \ 


-  <^>  1/2o 


2(1  +  /2) 


((5/2  -  3)(1  +  /2))1/2\z) 


((5  -  3/2X1  +  /2))1/2 


w.p .  1/6 


&  * 
ii)  v  is  a  zero  mean  Gaussian  noise  with  covariance  A  ,  where 


A  -  /  2  0  0\ 

f  °  !  0 

no  0  0/ 


iii)  the  saddle-point  value  of  J  is  J  *  2.1857. 

Again,  Che  optimal  policy  dictates  the  transmitter  to  use  two  of 
the  three  channels  simultaneously  at  any  time  such  that  each  channel  has 
the  same  probability  to  be  accessed  by  each  of  two  elements  of  the  input 
vector.  Hence,  it  again  admits  the  equilization  jamming  policy  in  equilibrium 
with  (y  ,5*). 

Example  3:  Set  n=3,  m=2 


3  0  0 
0  2  0 
0  0  1 


R  -  T  1  0  N 

R  '  U  2  1 


P-1  ,  Q=7 


The  saddle-point  solution  becomes  (again  using  Theorem  3.1) 


i)  (Y* ,<$*)  =  f  (  /1//3  0  O' 


/1//3  0  o\ 
1  0  00) 


0 


2/3 
0  0 
\  0  0 


z) 


w. p .  1/4 


(/- 1//3  0  0\  u,  1 


/  _L 


0 


0  0  0 


;  2/3 
0  0 
0  0 


z) 


w.p.  1/4 


0  ON  u. 


(/  0  0  ON 

li  1//3  00 ; 


1  \ 


0 

2/3 
0  0 

0  0 


z) 


w.p.  1/4 


</  0, 


,{  w  w  w 

I-  1/1/3  0  0 


0  0V  u,  /  0 - — \ 


2/3 
0  0 
0  0  / 


z) 


w.p.  1/4 


ii)  v  is  zero  mean  Gaussian  vector  with  covariance  A  =  ' 


f  4  0N, 


*  1 

iii)  the  saddle-point  value  is  J  =4  /3 


0  3  / 


The  result  here  is  in  the  same  spirit  as  that  of  Example  1. 

Example  4:  Take  m,  n,  I,  R  and  P  as  in  Example  3,  but  with  Q=0.5. 
Working  with  Theorem  3.1,  we  obtain: 


*  * 
i)  (Y  ,a  ) 


(Gu,  Kz) 
(-Gu,  -Kz) 


w.p.  1/2 
w.p.  1/2 


where  G  = 


// /4 . 5  -  1 X  1/2 

|  1  /4TT  +  2 


0 


K  = 


'((A3  -  l) (2  +  A3)) 

1.5/0 


0 

0 


1/2 


f  ((5 


2/73)  (2  +  A3)) 

0 


1/2 


ii)  v  is  a  zero  mean  Gaussian  noise  with  covariance 


=  /  0.5 

V  0 


0  J 


iii) 


J*  =  4.7745. 


In  this  last  example,  the  element  of  the  input  vector  corresponding 
to  the  smallest  eigenvalue  has  been  ignored  totally.  Since  the  power  of  the 
jammer  is  not  enough  to  equalize  the  two  eigenvalues  of  the  channel  noise, 
he  allocates  all  his  power  to  the  channel  corresponding  to  the  smallest 
eigenvalue.  The  overall  optimization  problem  for  the  transmitter  and  receiver 
pair  will  determine  globally  how  to  distribute  the  total  energy  over  the  first 
two  elements  of  the  input  vector.  Then  each  element  with  his  own  assigned 
amount  of  energy  plays  his  own  game  locally.  Hence,  the  result  can  be 
obtained  by  solving  two  independent  scalar  problems  in  parallel,  under  a 
specified  power  allocation  between  the  two  channels. 


3.3.  Derivation  of  Max. Min.  Solution  in  Vector  Case  (ii) 

We  now  direct  our  attention  to  vector  case  (ii),  and  discuss  the 
derivation  of  its  max. min  solution.  We  do  this  by  first  deriving  an  upper 
bound  on  the  max. min.  value  of  the  original  problem  by  restricting  the 
encoding  and  decoding  policies  to  a  smaller  domain,  ar.d  then  verifying  that 


*  ■  *  -  < 
. jLLjl. *! Jfc  ft  A II m,  i 


.1 


’nr/ 


for  some  jamming  policy,  this  upper  bound  is  actually  attainable  for  the 


original  problem. 

Let  us  first  introduce  here  a  new  matrix  it  .  ir  is  an  elementary 

R  R 

matrix,  ([7]),  which  simply  reorders  the  diagonal  elements  of  tt'(A  +  R)tt 
(it  has  been  defined  in  (3.1))  in  increasing  order  (but  not  necessarily 
diagonalizes  tt^(A  +  R)it),  i.e.. 


tt'  tt'(A  +  R)imR  *  /  ei  -•  •  •-  \  ;  o  <  ex. .  .<em  (3. 


W  1 


To  clarify  this  point,  let  us  illustrate  the  idea  of  it  in  the  following 

K 

example: 

We  wish  to  reorder  the  entries  of  M  =  /  7  8  9\  in  the  new  form  /  3 


4  5  6 

12  3 


-  -  5 


The  matrix  it  that  does  the  job  is  n  =  /  0  1  0  \  ,  whereby: 

R  R  /  0  0  1  ] 


V  0  V 

0  0  In  /  7  8  9\/0  1  0  \  =  /  1  2  3\/0  1  0\ 

1  0  0  J  (  4  5  6  )  (  0  0  1)  I  7  8  9  '  [  0  0  1  ' 

0  1  0/  \  1  2  3/  \  1  0  0/  \  4  5  6  J  \  1  0  0  J 


=  n  1  2\ 

19  1  8  1 

\  6  4  5  J 


and  ^irR  , 


/  0 

0 

1\ 

/  0 

1 

On  = 

/I 

!  l 

0 

0 

i  o 

0 

1 

1  0 

\  0 

1 

0  J 

\  1 

0 

0  J 

NO 

1  0  0\ 
0  10  1 
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By  following  through  the  lines  of  the  above  calculation,  we  claim  that 

an  appropriate  tt  always  exists.  For  convenience,  let  H  stand  for  the  set 

of  those  elementary  matrices.  Note  that  if  is  an  element  of  n,  then  its 

negative,  -tt  also  belongs  to  H. 

R 

Now,  coming  back  to  our  problem,  fix  jammer's  policy  at  u€i>,  and 

choose 


y  (u)  =  Au  ,  6  (z)  =  Kz  (3. 

where 

A=nu0GU  ,  K  =  Z  A'(A  E  A'  +  W)_1  (3.30; 

K 

(U  was  defined  in  3.2.) 
with 

^rtt'Wttttr  =  diag(o,  . .  .a,rh*+1, .  .  ,rm>  =  diag  («2  •••«,,)  (3.3i; 

The  remaining  notation  used  in  the  sequel  is  the  same  as  that 
introduced  earlier  at  the  beginning  of  Section  3.1.  Now  the  only  freedom 
left  in  the  minimization  of  J  over  the  restricted  domain  of  encoding  and 
decoding  policies  is  to  choose  an  optimal  from  the  set,  2  .  Algebraically, 

max.  min.  J  <  max.  min.  J  (3.32] 

y€0  p£t?  ’iSIT 

6€D  R 

where  J  =  E H  6  ( y  ( u )  +  v  +  r)  -  ull  2 


Considering  the  right-hand  side  of  (3.32), 


max.  min.  J  =  max.  min.  Efv'K'Kv  -  2v'K'(I  -  KA)u}  +  Tr{(I  -  KA) 
y€  d  *rG  ~  l,ed  tr€" 

Z(I  -  KA)  '  +  KRK  '}  (3.33 


Note  that  KA  =  Z  A"(A  I  A'  +  W)  A 


=  E  U'G'tt'u  "(ttit  GU  E  U'G'tt'it'  +  W)  ^nir  GU  (3.34 

R  K  R  R 

KA  =  E  ITG'(GUE  U'G'  +  tt^tt  "Wttttr)-1GU 

The  above  expression  (3.34)  is  constant  with  respect  to  either  the 

maximization  or  minimization  of  J  in  (3.33)  since  we  had  set  it  'it  'Wtttt  to  be 

R  R 

a  constant  matrix  in  (3.31).  Here,  let  E(uv')  =  N;  then  the  max. min.  problem 
in  (3.33)  is  reduced  to  the  following  equivalent  problem: 


max.  min. 

J  =  max .  min . 

Tr{AK'K  -  2K"(I 

-  KA)N  +  RK'K} 

n,a  ^p€n 

n, A  tt  e  n 

Tr { A } < Q  K 

Tr{A}<Q 

=  max .  min . 

[Tr{ (A  +  R)K'K} 

-  2Tr{K"(I  -  KA)N}] 

n,a  tt  en 

Tr{A}<Q  K 

Since  the  second  trace  in  (3.35)  can  be  always  be  made  positive  by 
an  appropriate  choice  of  tt  and  also  setting  N=0  does  not  affect  the  choice 
of  A,  the  jammer  will  set  N=0  in  (3.35).  Hence,  the  problem  further  reduces 
to 

max.  min.  J  =  max.  min.  Tr{ (A  +  R)K'K}  (3.36 

ps#  tt  s  n  pSd  tt  s n 

R  R 

Now,  writing  out  K'K,  we  have 

fCK  =  diag(— ^  JE  -  w.)  ...  (J-^  -  w,)0...0)t'»' 


(3.37 


Recall  Fact  I  in  Theorem  3.1 


a  / A . w.  a  A  .  w . 

o  ,  /  1  1  s  o  /  1  1 

—  ('/  -  -  w. )  >  —  (',/  — J - w.) 

w.  <  a  i  -  w.  v  a  1 

l  r\  1  J 


for  i<j 


in  view  of  which  the  diagonal  elements  in  (3.37)  are  in  decreasing  order. 
Rewriting  J  in  (3.36),  we  have 


a  'Aw 

o  „  11 


max.  min.  J  =  max.  min.  Tr{Tr'7r'(A  +  R)tttt  diag  ( —  (\, - w.)  ... 

»  r—  rr  «  rf  R  R  W-  V  Cl  1 

a  n  a  ttrg  n  l  o 

Tr{A}<  Q  Tr{A }<Q  n - 

a  f  X  „  w  „ 


-  (’/ 


w^)0. . .0) } 


a  /X  w 

=  max.  min.  Tr{ir"(ir'Ajr  +  0)%  diag(—  (V - w. ) 

A_<=-r  K  KK  W  Ya  1 

A  7T  fc  7t  1  o 

Tr{A}<Q 


a  /A  w„ 

^7  (V  o  "  w  )o-..°)} 

£  o 


=  max.  min.  Tr{ it ' (n  'A it  +  diag(r, , . . . ,r  ))tt 
A  tt  €n  R  1  m  F 

Tr{A}<Q  R  r -  r - 

-  ot  /a  w  a  /  A ,  w. 

,  .  .  o  .  11  .  of  c  2 

diag(—  ( - w.)  ...  —  (  - 

w.  .  x  1  w„  .  x 

1  o  l  o 


w,)0. . .0) > 

(3.3 


Obviously,  from  the  above  expression  in  (3.38)  and  the  property  of  tt  (which 

R 

always  orders  the  diagonal  elements  of  tt  'Att  +  diag(r^ .  .  .r  )  in  increasing 
order),  in  addition  to  the  Fact  I,  the  best  jammer  can  do  is  to  equalize  the 
eigenvalues  of  the  diagonal  matrix  diag (r^ . . . r  ) .  Hence,  the  optimal 

k 

covariance  matrix  A  satisfies 


s 


\- . :■,) 

Using  (3.39)  in  (3.12),  it  can  be  shown  by  mimicking  the  arguments 
used  in  the  proof  of  the  L.H.S.  inequality  of  Theorem  3.1,  that  the  upper 
bound  in  (3.32)  (max. min.  value  in  the  restricted  problem)  is  the  same  as 
the  saddle-point  value  in  Theorem  3.1.  Then,  (3.32)  becomes 

max.  min.  J  <  saddle-point  value  of  vector  case  (i)  (3.40) 

p€  y€  o 
5SD 

Now,  the  next  step  is  to  verify  the  attainability  of  the  upper  bound 

in  (3.40)  at  some  jamming  policy.  In  a  straightforward  fashion,  by  choosing 

v  the  same  as  in  (3.12)  of  Theorem  3.1,  the  minimization  of  J  over  the  space 

.'gxD  will  be  the  same  as  in  the  proof  of  the  right-hand  side  of  the  saddle-point 

inequality  in  Theorem  3.1.  Hence,  the  upper  bound  in  (3.40)  is  achievable  for 

at  least  one  jamming  policy.  We  summarize  the  above  results  in  the  following 

theorem,  which  uses  the  notation  introduced  at  the  beginning  of  Section  3.1. 

Theorem  3.2 :  For  the  communication  system  of  vector  case  (ii),  there  exist 

*  *  *  *  *  * 

two  max. min.  solutions  (y  ,<5  ,S  )  and  (-y  ,-5  ,-6  )  where 

i)  y*(u)  =  A*u  =  ttGUu  (3.41) 

ii)  v  =  n  (3.42) 

& 

where  n  is  a  zero  mean  Gaussian  noise  with  covariance  A  such  that 
.  * 

A  =  n  diag(a-r^ , . . . ,a-r^* ,0 . . . 0) *  ' ,  and  n  is  independent  of  all  other  random 


vectors . 
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k  *  k  k  —i 

iii)  6  (z)  =  Z  A  "(A  2  A  '  +  W)  z 


=  K  z 


iv)  J  = 


(I  A  w  )  +  Z  X. 

i=l  1  1  i=«.+l  3 


P  +  Z  w. 
i-1  1 


(3.44) 


□ 


Here,  ir,U,G,W,a,  and  h  are  as  defined  by  (3.1),  (3.2),  (3.8),  (3.5),  (3.6), 
and  (3.7),  respectively. 

The  max. min.  solution  presented  in  Theorem  3.2  is  in  almost  the 
same  form  as  the  saddle-point  solution  of  vector  case  (i)  (in  Theorem  3.1). 

k  k 

The  only  difference  is  that  (y  ,6  )  in  (3.41)  and  (3.43)  is  one  of  the 

k  k 

realizations  of  (y  ,6  )  in  (3.11). 


3.4.  Derivation  of  a  Min. Max.  Solution  for  Vectpr  Case  (ii) 

In  this  section,  we  present  a  min. max.  solution  in  closed  explicit 
form  in  some  parametric  regions.  (But  unfortunately,  for  certain  parametric 
regions,  we  still  do  not  have  a  closed  explicit  forms  for  a  min. max.  solution, 
and  at  this  point  this  seems  to  be  quite  impossible.) 

Before  presenting  the  main  result  in  Theorem  3.3,  we  introduce  some 
new  notation  (in  addition  to  those  introduced  earlier)  : 

Define 

i _ 

r~  2  x 

~  v  Q )  +  z  ri 

i=l 

where  I  is  the  maximum  integer  which  satisfies 


9, 

Z 

=  1 


FFi 


•t  *»■ 


ii)  £  (a) 


* 

V  (-u) 


1-/1 


(3.51) 


o  (z) 


(3.52) 


Z  X. 

i-1  1 


(  zVVi)2 


(/P  -  /Q)2  +  Z  r. 


+  Z  X .  in  R, 

i-t+i  1  6 


(3.53) 


Proof :  The  proof  of  the  min. max.  solution  in  Region  R,.  is  just  straight¬ 
forward  vector  extension  of  the  proof  for  the  scalar  problem  in  Theorem  2.3; 
hence,  we  go  directly  to  the  proof  for  the  Region  R^. 

Analogous  to  the  case  of  Theorem  3.2,  we  first  derive  a  lower 
bound  for  the  original  min. max.  problem  and  then  verify  the  attainability  of 
the  lower  bound  at  some  encoding  and  decoding  policies  for  the  original 
problem.  First  we  set  up  the  inequality. 


min.  max.  J  >  min.  J  (y(u),6(z),  v  = 

y  6  ■  U  €  t>  y  €  n 

iSDS  5  €  D 


-  *  E(x ! u) ) 


(3.54) 


where  x  is  the  random  variable  generated  by  y(u). 
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Considering  the  right-hand  side  of  (3. 54),  z  becomes 

-/l  E(x[u)  +  r 


z  =  x 


(3.55) 


Now,  rewrite  z. 


=  (1  -/$)x  -  E(x  |  u) )  +  r 


(3.56) 


and  consider  a  new  minimization  problem  by  splitting  expression  (3.56)  into 


two  parts:  z^  and  z^,  where 


Z1  =  (1  »  p")x  +  r 


=  /"f(x  "  E(x |  u) ) 


(3.57) 


Instead  of  z  in  (3.56),  z^  and  z9  in  (3.57)  will  be  received  by  the  receiver. 
This  new  problem  will  achieve  a  minimum  square  error  which  is  lower  than  the 
one  of  the  problem  defined  by  the  right-hand  side  of  (3.54).  By  manipulating 
on  these  data  z^  and  z0  algebraically,  we  obtain 


/  - 
z 


'1  ,  1 

x  +  -  r 


1  iV?  1- 


(3.58) 


\  z2  E 


n 


=  x  -  E(x|u) 


Further , 


(  Zl=X+ 


1 


(3.59) 


i  z  ^  -  z  9  =  E(x;u)  + 


1 
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Since  the  problem  in  (3.57)  has  just  been  linearly  transformed  into  the 
problem  in  (3.59),  we  claim  that  both  minimization  problems  over  the  space 
Q^xD  are  equivalent.  By  inspection  on  (3.59),  we  see  that  the  randomized 
encoding  policy  is  totally  unnecessary;  hence,  we  can  say  that  an  optimal 
encoding  policy  exists  as  a  deterministic  function  of  u.  Coming  back  to 
the  problem  in  (3.57),  z?  =  0,  and  we  are  left  with  only  z^  =  (1  +  r. 

This  problem  has  been  solved  in  [5]  and  [6],  with  the  solution  being 

*  -  *  ★  ~  k  k 

Y  (u)  =  A  u,  and  6  (z)  =  K  z  with  the  mean  square  error,  J  specified  in 
(3.53).  To  summarize,  from  (3.54),  we  have 


min.  max.  J  > 
Y  e  U  e  # 

6€  D 


(  Z  V  Vi)2 
i=l 


(/P  -  v'V  +  I 


i=l 


r . 

l 


n 

E 

i=£+l 


(3.60) 


Now  to  complete  the  proof,  we  have  to  verify  the  attainability  of  the  lower 
bound  in  (3.57). 

Starting  with  the  encoding  and  decoding  policies  in  (3.50)  and 
(3.52),  respectively,  the  maximization  of  J  becomes 


1  ~ * 

max .  J  ( - ^  A  u  ,  K  z ,  u ) 


-/I 


k  k  k  1  *V  v.  k 

max.  E{v'K  'K  v  -  2v^K  '(I  -  - —  K  A  )u} 

•,€  d 


x  -/¥ 


KA  V  A  * 

+  Tr  (I - — — )  E  (I - — —  )'  +  K  RK  '} 


1  Vf  1  -v 


0 


(3.61) 


■J"  >■■  u  < 
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Since  the  trace  in  (3.62)  does  not  depend  on  the  distribution  u 
reduces  to 


max.  J  =  max.  E{v"K  'K  v  -  2v  K  '(I  -  — — — — )u} 
..  e  i?  pEi) 


Vi 


Firstly,  write  out  K  "K  and  K.  '(I  -  — ^ — ), 


i-TI 


K  'K  =  ”■  dia 


.  ri ,  FFi  “i .  /vF 
“<^<v~-ri>- n  V—  -r« 


K  '(I  - 


K  A 


>  -  .  1 


ot  A  /a,  r,  P 

(V-T^  -  a!  )1/-(-  /Q  +  \/  -^) 


P  -  /Q 


a, a:  ,  /^TV'P 

(\/-pf-  *)  /2(-  ^  +  vA~)  \ 

— - — - - - - —  0...0;U 

/p  -  /Q  / 


Secondly,  perforin  the  linear  transformation,  n'  =  v'iiorn  =  ir 


the  problem  in  (3.62)  becomes  equivalent  to 


rr 


max  J 


I  A  /  Airi  a!  / 

•  Er*dia%  (v— -  ri>---FF  (v 


ct,  ';'xjr?  N 

—  -  r  r )  0 .  . .  0  in 

CL,  K  J 


Axi  a/2, 


i  i 

/w 


-  2n  ’  dia 


(/v^T"“i)  vQ  +v  h 


■) 


/p  -  /q 

,  /VT  1/2,  .  /V)-p, 

(V”"ai)  (-‘Q-hy— r-)  N 

- - - - — - - — )  0 ...  0  i  Uu 

/P  -  /q  / 


,  the  problem 


(3.6! 


(3.6 


(3.6 

v.  Then, 


subject  to  E(n'->)  <  0. 
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2  2 

Now,  let  ctt  =  E(ni),  u  =  Uu.  Then  the  problem  can  be  expressed  as 


[ol  .  A 

l  i 


-  -v1/2(-  ^  + 


l  a  A.  r.  j  l 

max  J  =  £  —  ( U  1  ■  —  -  r .)  a .  -2  E 

.  .  r,  V  a,  ii  .  . 

i=l  l  1  1=1 


/Pa .  r . 

'  i  i. 


ni 


/P  -  /q 


E(uini) 


(3.66) 


By  Cauchy-Schwartz  inequality,  for  a  fixed  set  (g^...c~). 


max  I E(u . n . ) I  =  o./l. 

'll1  l  l 


(3.67) 


a . 

l 


alrl 


Since  in  Region  ,  Q  <  — —  P,  the  problem  in  (3.66)  further  reduces  to 


max. 


°is 


7  a  A .  r .  ~ 

J  =  max .  \  Z  —  ( J  — — —  -  r  . )  a  . 

i-i  ri  v  \ 


0  .  S 
1 


l<i<H 


1  <  i  <  1 

?  ?  2  ~  ~  2 

a“  +...+  c~  <  Q  a.  +...+  a:  <  Q 

I  :  -  1  *.  — 


ra .  \ 


/a . 

yr-  ,  /  1  1 

?  V  A  , 


i  </ A1  -  »i>1/2<-  '0  V-p> 


Pa .  r . 


+  2 


(3.68) 


i  =  l 


/P  -  V"  0 


The  above  maximization  problem  admits  a  unique  solution  on  (c^...Jr)  [4], 


which  is 


i  (a  -  ni) 


,  i=l - - 


(3.69-) 


J 


J 


where 


/P  -  /q 
a  =  - -*•  a. 


Thus, 


1  S¥  -  Sq 


,,/Vi  1/2  ; 

C\J  _  -r^)  ,  i  l, . . . 


*  * 

In  conclusion,  given  y  and  6  in  (3.50)  and  (3.52),  respectively,  the 
maximization  of  J  over  d  admits  a  unique  optimal  jamming  policy  specified 
by  (3.67)  and  (3.71). 

The  next  step  is  to  show  that  the  unique  optimal  jamming  policy 
obtained  above  is  actually - A*u  (or  -J^x). 

*  1  "  P 

*  ai  - 

By  (3.67),  *  -  -  u^^  ,  0  <  i  <  %.  Hence, 

/TT 

i 


*  i  u  j 

n  =  -  diag( -  ...  — ~  0...0)Uu 

kTi 

leading  to 


*  *  w]_ 
=  irn  =  -tt  diag( - 


0. . .0)Uu 


v 
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XT. 


1  -* 

By  referring  back  to  (3.57)  and  noting  that  x  =  - —  A  u,  we  establish  the 


1  Vp 


attainability  of  the  lower  bound. 

The  proof  of  Theorem  3.3  is  thus  completed.  ° 

Toward  the  end  of  this  section,  we  will  illustrate  the  spirit  of 
Theorem  3.3  with  an  example. 


Example :  Take  P=40,  Q=10,  E= 


-(: :) 


10  0  O' 

,  and  R= [  0  11  0  ].  Then,  working 

0  0  12 


through  Equations  (3.45)-(3.49) ,  we  obtain,  if  1=  2, 
2 


/a = 


I  .  r  . 
i-1 *  11 


/io  +  /IT 


(/p  -  /q)2  +  l  t.  (Ao  -  Ao)2  +  21 

i=l  X 


a1  =  0.04368 


checking  the  validity  of  1=2  with  (3.46),  we  obtain 


—  =  qV  =  0.09091  >  a, 
r2  11  1 


=  0.2090 


Hence,  1=2  is  valid. 


alrl 


Now,  checking  with  (3.49),  to  see  whether  Q  <  — - —  P  ,  we  obtain 


1 


alrl 

\ 


P  =  0.04368  x  10  +  40  =  17.4720 


so,  indeed,  Q  =  10  <  17.472. 

After  checking  all  the  necessary  conditions,  we  apply  Theorem  3.3  to  obtain 
a  min. max.  solution. 


a.  n  m _ i.  »■  M  ^  .. f  .  ft  1  ii.i  , 


Using  (3.47)  to  obtain 


/  10 

-  10) 1/2 

11  -  (\, 

1  0.04368 

22  (\ 

/  11 

-  U)1/2 

/  0.04368 

//I 

//! 


A  =  G 


2.26510  0 

0  2.20663 

0  0 


2.26510 

2.20663 


By  (3.48), 


-*  _i 

K  =  Z  A  '  (A  Z  A  '  +  R) 

=  A  "(A  A  "  +  R) 


/  0.1497  0  ON 

\  0  0.13905  0  ) 


i  1 

also  ,y  p  -  j 

Applying  (3 . 50) -(3 .53) ,  we  have  a  min. max.  solution  as  given  below 


i)  Y  (u)  = 


ii)  6  (u)  = 


Lii)  d*(z)  = 


2  f 1. 26510 

f  0 

\  0 

\ 

-  / 2.26510 
0 
0 


\ 


0.1497 

0 


0  \  u 

2.20663  ) 

0 

/ 

0  \  u 

2.20663 


0 


/ 


0  0\  z 

0.13905  0  / 


_* 

iv)  J 


1.35411 


In  the  preceding  example,  both  channels  have  been  used  and  the  smallest  signal 
eigenvalue  has  not  transmitted,  as  dictated  by  the  optimality  of  the  solution. 


Also,  one  interesting  special  structure  of  vector  case  (ii) 
is  worth  mentioning  here.  When  the  communication  system  consists  of  only  one 


channel,  the  min. max.  problem  becomes  equivalent  to  the  scalar  min. max. 
problem  of  Section  2.3  since  only  the  largest  signal  eigenvalue  is  transmitted 
through  the  single  channel  [5], [6],  i.e.,  uEUu  and  u=(u^...un)  s.t.  only  u^ 

will  be  encoded  and  transmitted. 

3.5.  Summary  of  the  Solutions  in  All  Vector  Cases 

Let  us  now  collect  the  results  presented  in  the  previous  sections 
and  present  them  comparatively  in  Table  3.1.  The  highlights  of  this 
comparison  are  the  following: 

i)  The  saddle-point  value  of  J  in  vector  case  (i)  is  the  same  as  the  max. min. 

* 

value  of  J,  J  in  vector  case  (ii) .  Notationally ,  max. min.  of  vector  case  (i) 
*=*  max. min.  of  vector  case  (ii)  . 

—  ft 

ii)  In  Region  R^,  the  min. max.  value  of  J,  J  ,  for  vector  case  (ii)  is 

ft 

strictly  greater  than  the  max. min.  value  of  J,  J  ,  in  vector  case  (ii)  and 
the  saddle-point  value  of  J  in  vector  case  (i). 


SUMMARY  OF  THE  RESULTS  IN  ALL  VECTOR  CASES 


CHAPTER  4 


CONCLUSION 


4.1.  Summary  of  Results 

This  thesis'  principal  objective  has  been  to  obtain  saddle-point 
or  worst-case  solutions  for  a  class  of  communication  systems.  The  precise 
mathematical  formulation  of  the  problems  has  been  provided  in  Chapter  1. 
Repeating  briefly  here,  the  problems  involved  the  transmission  of  a  sequence 
of  independent,  identically  distributed  Gaussian  random  variables  over  the 
time-discrete  additive  white  Gaussian  channel  which  was  subjected  to 
statistically  unknown  jamming  noise  generated  by  an  intelligent  jammer.  The 
jammer  was  intelligent  because  he  had  access  to  the  input  variables.  The 
scalar  case  (i)  (single  input-single  channel)  referred  to  the  communication 
system  in  which  a  noiseless  side  channel  was  present  for  the  transmission  of 
the  information  about  the  current  structure  of  the  encoder  to  the  decoder, 
in  addition  to  the  main  communication  channel.  The  vector  case  (i),  of  course 
was  the  vector  extension  of  the  scalar  case  (i) ,  in  which  vector  input 
variables  were  transmitted  over  multiple  channels  and  at  the  same  time  the 
vector  problem  still  maintained  the  structure  of  the  scalar  problem.  Besides 
the  absence  of  the  side  channel,  the  scalar  case  (ii)  and  vector  case  (ii) 
were  similar  to  the  scalar  case  (i)  and  vector  case  (i),  respectively. 

In  Chapter  2,  we  first  reviewed  the  recent  literature  [3]  closely 
related  to  our  present  work.  Following  that,  a  saddle-point  solution  was 
obtained  for  the  scalar  case  (i) .  It  appeared  that  the  encoding  policy  was 
a  mixing  policy  of  two  optimal  linear  decision  rules  on  u  with  equal 
probability;  in  turn,  the  jamming  policy  was  forced  to  be  uncorrelated 


Ltl*1 


with  input  signal  (actually,  being  an  independent  Gaussian  noise).  A  max. min. 
solution  was  also  derived  for  scalar  case  (ii) ,  in  which  the  encoding  policy 
was  always  a  linear  function  of  u  and  the  jamming  policy  turned  out  to  be  an 
independent  Gaussian  noise.  Furthermore,  its  max. min.  value  is  the  same  as 
the  saddle-point  value  in  scalar  case  (i) .  We  also  obtained,  in  the  same 
chapter,  a  min. max.  solution  for  scalar  case  (ii)  The  solutions  were 
structurally  different  in  the  three  parametric  regions.  Nevertheless,  the 
optimal  encoding  policy  was  always  a  linear  function  of  u.  Depending  on  the 
parametric  regions,  the  general  form  of  the  jamming  policy  consisted  of  a 
linear  function  of  u  and  an  independent  Gaussian  random  variable.  In  scalar 
case  (ii) ,  the  min. max.  value  was  always  strictly  greater  than  the  max. min. 
value.  In  all  cases,  the  optimal  decoding  policy  was  always  a  Bayes' estimate. 
Finally,  Chapter  2  also  provided  a  summary  of  all  the  scalar  results,  in  the 
last  section. 

In  Chapter  3,  we  tackled  the  vector  cases  in  a  way  similar  to 


Chapter  2. 


The  encoding  policy  was  restricted  to  the  mixing  policies  of 


linear  decision  rules  for  the  sake  of  mathematical  tractability .  Again,  a 
saddle-point  solution  existed  for  vector  case  (i),  in  which  the  encoding  policy 
was  a  randomized  policy  with  uniform  discrete  probability  over  a  set  of 
optimal  linear  decision  rules,  and  the  jammer  adopted  an  independent  Gaussian 
random  vector,  which  equalized  the  eigenvalues  of  channel  noise.  The  max. min. 
solution  of  vector  case  (ii)  had  the  same  structure  as  vector  case  (i) ,  besides 
the  fact  that  its  encoding  and  decoding  policies  were  ones  of  possible 
realizations  of  the  mixing  policy  of  vector  case  (i) .  Then  a  min. max. 
solution  was  derived  in  an  explicit  closed  form  for  parametric  regions  R. 


i  \  •  *. 


p‘ 


and  R, .  In  R, ,  both  the  encoding  and  jamming  policies  were  nonrandomized 
o  o 

linear  decision  rules  on  u.  Similar  to  the  scalar  cases,  the  optimum 
decoding  policy  was  a  Bayes'  estimate  in  all  cases.  Also,  some  numerical 
examples  were  worked  out  to  illustrate  the  spirit  of  the  theorems  of 
Chapter  3. 

4.2.  Continuation  and  Extension 

In  this  section  we  discuss  some  future  work  which  may  stem  from  this 

thesis.  Our  continuing  goal  is  to  pursue  a  complete  set  of  min. max.  solutions 

for  the  vector  case  (ii) .  Outside  the  regions  R,.  and  R^,  the  problem  does  not 

seem  to  admit  an  explicit  closed-form  solution,  so  that  our  preference  would 

be  to  derive  a  recursive,  numerical  procedure  for  obtaining  the  solutions. 

—  * 

However,  we  feel  that  the  min. max.  value  of  J,  J  is  always  strictly  greater 

* 

than  the  max. min.  value  of  J,  J  ;  that  is,  the  saddle-point  solution  never 
exists . 

The  scalar  case  (ii)  treated  in  this  thesis  can  be  extended  to  a 
more  complicated  version  analogous  to  the  communication  system  as  depicted  in 
Figure  4.1.  The  only  difference  between  the  system  in  [8]  and  the  extended 
system  in  Figure  4.1  is  that  the  jammer  in  [8]  taps  the  output  of  the 
encoder,  {xt  },  instead  of  tapping  the  input,  { m  t } .  The  extended  system 

j 

here  follows  the  same  structure  as  the  communication  system  in  [8]  except  for 
this  difference.  So,  the  extended  problem  is  to  consider  the  transmission  of 
a  sequence  of  random  variables  generated  by  a  Gaussian  discrete-time  Markov 
process,  {m  } ,  over  a  time-discrete  additive  white  Gaussian  channel  in  the 
presence  of  an  intelligent  jammer  and  an  independent  white  Gaussian  variable 


{w  },  i.e.,  {mt}  is  described  by 

j 


™c+1  =  Atmt  +  BtCt  ,  t=0,l,... 


where  {t.  :  j=l..n}  are  the  sub-time  indices  between  t  and  t+1 ,  {£  }  is  a 
J  t 

q-dimensional  standard  Gaussian  white  noise  process,  m^  is  Gaussian  with  mean 

zero  and  variance  p^,  and  B  is  a  Ixq  vector.  During  the  interval  between  the 

arrival  of  successive  input  variables,  and  m  the  channel  can  be  used 

n  times  such  that  each  time  the  encoding  policy  will  satisfy  the  channel  input 

2 

power  constraint,  i.e.,  E(xt  )  <  P.  The  encoder  can  also  access  the  channel 

j 

output  {z  }  through  a  noiseless  feedback,  link.  Overall,  the  new  problem  is 

j 


still  to  seek  the  saddle-point  solution,  or  if  it  does  not  exist,  the  worst 
case  solutions  by  both  min. max.  and  max. min.  approaches. 

In  [8],  two  separate  problems  have  been  solved  under  the  following 
specifications:  (a)  the  jamming  noise  {v^  }  is  correlated  with  the  encoded 

signal  {x  },  and  (b)  the  jamming  noise  (v  } is  taken  to  be  independent  of 

i  j 

the  encoded  signals  (x^  }  and  all  other  random  processes.  Saddle-point 

j 

solutions  exist  for  both  problems.  The  general  form  of  encoding  policies  is 
a  linear  innovation  process  on  the  input  and  the  channel  output  (z  },  and  the 

j 

decoders  are  always  Bayes' estimates  for  the  corresponding  situation.  However, 
the  jamming  policies  admit  different  structures  for  these  two  problems.  In 
problem  (a) ,  the  jamming  policy  consists  of  a  linear  function  of  the  encoded 
signal  {xc  }  and  an  independent,  white  Gaussian  process.  For  (b) ,  the  jamming 

j 

policy  consists  of  only  an  independent  white  Gaussian  process.  By  recalling 


the  similarity  between  scalar  case  (ii)  and  scalar  case  (iii),  (Table  2.1) 
and  the  Gaussian  property  of  the  problem,  we  feel  that  the  min. max.  and 
max. min.  approaches  in  the  extended  problem  should  lead  to  the  same  solutions 
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